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The theory of large deviations is concerned with the exponential decay of probabilities of large 
fluctuations in random systems. These probabilities are important in many fields of study, including 
(^\ statistics, finance, and engineering, as they often yield valuable information about the large fluctuations 

^^ of a random system around its most probable state or trajectory. In the context of equilibrium statistical 

mechanics, the theory of large deviations provides exponential-order estimates of probabilities that 
refine and generalize Einstein's theory of fluctuations. This review explores this and other connections 
op between large deviation theory and statistical mechanics, in an effort to show that the mathematical 

language of statistical mechanics is the language of large deviation theory. The first part of the review 
presents the basics of large deviation theory, and works out many of its classical applications related 
f^ to sums of random variables and Markov processes. The second part goes through many problems 

CN| and results of statistical mechanics, and shows how these can be formulated and derived within the 

context of large deviation theory. The problems and results treated cover a wide range of physical 

(— I systems, including equilibrium many-particle systems, noise-perturbed dynamics, nonequilibrium 

O systems, as well as multifractals, disordered systems, and chaotic systems. This review also covers 

^ many fundamental aspects of statistical mechanics, such as the derivation of variational principles 

P^ characterizing equilibrium and nonequilibrium states, the breaking of the Legendre transform for 

^ nonconcave entropies, and the characterization of nonequilibrium fluctuations through fluctuation 

^ relations. 
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I. INTRODUCTION 

The mathematical theory of large deviations initiated by Cramer [ ] in the 1930s, and later developed 
by Donsker and Varadhan [65, 66, 67, 68] and by Freidlin and Wentzell [106] in the 1970s, is not a theory 
commonly studied in physics. Yet it could be argued, without being paradoxical, that physicists have been 
using this theory for more than a hundred years, and are even responsible for writing down the very first 
large deviation result [ ]. Whenever physicists calculate an entropy function or a free energy function, 
large deviation theory is at play. In fact, large deviation theory is almost always involved when one studies 
the properties of many-particle systems, be they equilibrium or nonequilibrium systems. So what are large 
deviations, and what is the theory that studies these deviations? 

If this question were posed to a mathematician who knows about large deviation theory, he or she might 
reply with one of the following answers: 

• A theory dealing with the exponential decay of the probabilities of large deviations in stochastic 
processes; 

• A calculus of exponential-order measures based on the saddle -point approximation or Laplace's 
method; 

• An extension of Cramer's Theorem related to sample means of random variables; 

• An extension or refinement of the Law of Large Numbers and Central Limit Theorem. 

A physicist, on the other hand, who is minimally acquainted with the concept of large deviations, would 
probably answer by saying that large deviation theory is 

• A generalization of Einstein's fluctuation theory; 

• A collection of techniques for calculating entropies and free energies; 

• A rigorous expression of saddle -point approximations often used in statistical mechanics; 

• A rigorous formulation of statistical mechanics. 

These answers do not seem to have much in common, except for the mention of the saddle-point 
approximation, but they are really all fundamentally related. They differ only in the extent that they refer to 
two different views of the same theory: one directed at its mathematical applications — the other directed at 
its physical applications. 

The aim of this review is to explain this point in detail, and to show, in the end, that large deviation theory 
and statistical mechanics have much in conomon. Actually, the message that runs through this review is more 
ambitious: we shall argue, by accumulating several correspondences between statistical mechanics and large 
deviation theory, that the mathematics of statistical mechanics, as a whole, is the theory of large deviations, 
in the same way that differential geometry, say, is the mathematics of general relativity. 

At the core of all the correspondences that will be studied here is Einstein's idea that probabilities can be 
expressed in terms of entropy functions. The expression of this idea in large deviation theory is contained 
in the so-called large deviation principle, and an entropy function in this context is called a rate function. 
This already explains one of the answers given above: large deviation theory is a generalization of Einstein's 
fluctuation theory. From this first correspondence follows a string of other correspondences that can be 
used to build and explain, from a clear mathematical perspective, the basis of statistical mechanics. Large 
deviation theory explains, for example, why the entropy and free energy functions are mutually connected by 
a Legendre transform, and so provides an explanation of the appearance of this transform in thermodynamics. 
Large deviation theory also explains why equilibrium states can be calculated via the extremum principles that 



are the (canonical) minimum free energy principle and the (microcanonical) maximum entropy principle. In 
fact, large deviation theory not only justifies these principles, but also provides a prescription for generalizing 
them to arbitrary macrostates and arbitrary many-particle systems. 

These points have already been recognized and "publicized" to some extent by a number of people, who 
see large deviation theory as the proper mathematical framework in which problems of statistical mechanics 
can be formulated and solved efficiently and, if need be, rigorously. Ellis [ ] is to be credited for providing 
what is perhaps the most complete expression of this view, in a book that has played a major part in bringing 
large deviations into physics. The idea that statistical mechanics can be formulated in the language of large 
deviations has also been expressed in a number of review papers, including one by Oono [222], two by Ellis 
[85, Hf], and the seminal paper of Lanford [l68], which is considered to be the first work on large deviations 
and statistical mechanics. Since these works appeared, more applications of large deviations have seen the 
light, so that the time seems ripe now for a new review. This especially true for the subjects of long-range 
interaction systems, nonconcave entropies, and nonequilibrium systems, which have all been successfully 
studied recently using large deviation techniques. 

Our efforts in this review will go towards learning about the many applications of large deviation theory 
in statistical mechanics, but also, and perhaps more importantly, towards learning about large deviation 
theory itself. The presentation of this theory covers in fact about half of this review, and is divided into 
three sections. The first presents a series of simple examples that illustrate the basis of the large deviation 
principle (Sec. II). There follows a presentation of large deviation theory proper (Sec. Ill), and a section 
containing many illustrative examples of this theory (Sec. IV). These examples are useful, as they illustrate 
many important points about large deviations that one must be aware of before studying their applications. 

The content of these three mathematical sections should overall be understandable by most physicists. A 
great deal of effort has been put into writing an account of large deviation theory which is devoid of the many 
mathematical details commonly found in textbooks on large deviations. These efforts have concentrated 
mainly on avoiding the use of measure theory and topology, and on using the level of rigor that prevails 
in physics for treating limits and approximations. The result is likely to upset mathematicians, but will 
surely please physicists who are looking for a theory with which to do calculations. Many mathematical 
elements that are omitted in the presentation are mentioned in the appendices, as well as in various other 
sections, which also point to many useful references that treat large deviations at the level of rigor demanded 
by mathematicians. 

The physical applications of large deviations are covered in the second part of this review. The list of 
applications treated in the three sections that make up this part is not exhaustive, but covers most of the 
important applications related to equilibrium statistical mechanics (Sec. V) and nonequilibrium statistical 
mechanics (Sec. VI). The correspondence between large deviation theory and Einstein's fluctuation theory is 
fully explained in the section dealing with equilibrium system. Other topics discussed in that section include 
the interpretation of the entropy as a rate function, the derivation of the Legendre transform connecting the 
entropy and the free energy, and the derivation of general variational principles that characterize equilibrium 
states in the microcanonical and canonical ensembles. The topics discussed in the context of nonequilibrium 
systems are as varied, and include the study of large deviations in stochastic differential equations (Freidlin- 
Wentzell theory), dynamical models of equilibrium fluctuations (Onsager-Machlup theory), fluctuation 
relations, and systems of interacting particles. Other applications, related to multifractals, chaotic systems, 
spin glasses, and quantum systems, are quickly covered in Sec. VII. 

As a warning about the sections covering the physical applications, it should be said that this work 
is neither a review of statistical mechanics nor a review of large deviation theory — it is a review of the 
many ways in which large deviation theory can be applied in statistical mechanics. The list of applications 
treated in this work should be viewed, accordingly, not as a complete list of applications of large deviation 
theory, but as a selected list or compendium of representative examples that should serve as useful points of 
departure for studying other applications. This is especially true for the examples discussed in the section on 
nonequilibrium systems (Sec. VI). At the time of writing this review, a complete theory of nonequilibrium 
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FIG. 1; Rate function I{r) for Example ILL 

systems is still lacking, so it is difficult to provide a unified presentation of these systems based on large 
deviation theory. The aim of Sec. VI is to give a broad idea of hovi' large deviation techniques can be applied 
for studying nonequilibrium systems, and to convey a sense that large deviation theory is behind many results 
related to these systems, just as it is behind many results related to equilibrium systems. One could go further 
and argue, following Oono [222] and Eyink [95] among others, that large deviation theory is not only useful 
for studying nonequilibrium systems, but provides the proper basis for building a theory of these systems. 
Section VI was written with this idea in mind. 

II. EXAMPLES OF LARGE DEVIATION RESULTS 

Before we immerse ourselves into the theory of large deviations, it is useful to work out a few examples 
involving random sums to gain a sense of what large deviations are, and a sense of the context in which these 
deviations arise. The examples are purposely abstract, but are nonetheless simple. The goal in presenting 
them is to introduce some basic mathematical ideas and notations that will be used throughout this review. 
Readers who are already familiar with large deviations may skip this section, and start with Sec. Ill or even 
Sec. V. 

Example II.l (Random bits). Consider a sequence b = {bi,b2, ■ ■ ■ , bn) of n independent random bits 
taking the value or 1 with equal probability, and define 

1 " 

i?n = -V6i (1) 

n ^-^ 

i=l 

to be the fraction of I's contained in b. We are interested to find the probability P{Rn = r) that i?„ assumes 
one of the (rational) values 0, 1/n, 2/n, . . . , n/n. Since the bits are independent and unbiased, we have 
P{b) = 2"" for all b e {0, 1}", so that 

P(R^ = r)= y P(b) = — , ,„,'"' ^— . (2) 

^ ' ^ ^ ' 2"(m (1-r n ^ ' 

Using Stirling's approximation, n! ^ n"e~", we can extract from this result a dominant contribution having 
the form 

P(ii„ = r) f« e-"^^''), /(r) =ln2 + rlnr + (l-r)ln(l-r) (3) 

for n large. The function /(r) entering in the exponential is positive and convex for r G [0, 1], as shown in 
Fig. 1, and has a unique zero is located at r = 1/2. 

The approximation displayed in (3) is an example of large deviation approximation. The exponential- 
decaying form of this approximation, combined with the expression of the decay or rate function I{r), shows 
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FIG. 2: Gaussian sample mean with fj, — a — I. (a) Probability density p{Sn = s) for increasing values of n together 
with its corresponding rate function J{s) (red line), (b) Typical realization of Sn converging to its mean. 



that the "unbalanced" sequences of n bits that contain more O's than I's, or vice versa, are unlikely to be 
observed as n gets large because P{Rn) decays exponentially with n for i?„ / 1/2. Only the "balanced" 
sequences such that i?„ ss 1/2 have a non-negligible probability to be observed as n becomes large. 

The next example discusses a different random sum for which a large deviation approximation also holds. 

Example II.2 (Gaussian sample mean). The random variable Rn, defined in the previous example as a 
sum of n random variables scaled by n, is called in mathematics a sample mean. In the present example, we 
consider a similar sample mean, given by 



S^, 



1 " 

n ^ ~ / , -^ii 



(4) 



1=1 



and assume that the random variables Xi are independent and identically distributed (IID) according to the 
Gaussian probability density 



p{Xi 



1 



\/27rcr2 



^(x'.-M)V(2c72) 



(5) 



The parameters fx and a"^ represent, as usual, the mean and variance, respectively, of the Xj's. 
The probability density of 5„ can be written as the integral 



P{Sn 



p{x) dx 



'{x&K":Sn(x)=s} 

where x = (xi, X2, . . . , x„) is the vector of random variables, and 

p{x) =p{xi,X2,...,Xn) = p{xi)p{x2) ■ ■ ■ piXn) 

their product density. The solution of this integral is, of course, 

-n(s-/.)V(2a2) 



S{Snix) - s) p{x) dx = {5{Sn - s)) 



p{Sn = s) 



n 



2txg^ 



(6) 



(7) 



(8) 



since a sum of Gaussian random variables is also exactly Gaussian-distributed. A large deviation approxima- 
tion is obtained from this exact result by neglecting the term ^Jn, which is subdominant with respect to the 
decaying exponential, thereby obtaining 
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FIG. 3: Exponential sample mean with ^ = 1. (a) Probability density p{Sn = s) for increasing values of n together 
with its corresponding rate function J{s) (red line), (b) Typical realization of Sn converging to its mean. 



The rate function J{s) that we find here is similar to the rate function I{r) found in the first example — it 
is convex and possesses a single minimum and zero; see Fig. 2(a). As was the case for I{r), the minimum 
of J{s) has also for effect that, as n grows, p{Sn = s) gets more and more concentrated around the mean 
fi because the mean is the only point for which J(s) = 0, and thus for which p{Sn = s) does not decay 
exponentially. In mathematics, this concentration property is expressed by the following limit: 



lim P{Sn G [fi-S,fi + 5]) = 1, 



(10) 



where 6 is any positive number. Whenever this limit holds, we say that Sn converges in probability to its 
mean, and that Sn obeys the Law of Large Numbers. This point will be studied in more detail in Sec. III. 

In general, sums of IID random variables involving different probability distributions for the summands 
have different rate functions. This is illustrated next. 

Example II.3 (Exponential sample mean). Consider the sample mean Sn defined before, but now suppose 
that the IID random variables Xi,X2, ■ ■ . , Xn are distributed according to the exponential distribution 



p{Xi 



1 
— f 



-Xi/fl 



Xi > 0, fi > 0. 



For this distribution, it can be shown that 



p(5„ = s)«e-"-^(^), J is) 



s 



1 



In-, s > 0. 



(11) 



(12) 



As in the previous examples, the interpretation of the approximation above is that the decaying exponential 
in n is the dominant term of p{Sn = s) in the limit of large values of n. Notice here that the rate function is 
different from the rate function of the Gaussian sample mean [Fig. 3(a)], although it is still positive, convex, 
and has a single minimum and zero located at s = /i that yields the most probable or typical value of Sn in 
the limit n -^ oo; see Fig. 3(b). 

The advantage of expressing p{Sn = s) in a large deviation form is that the rate function J{s) gives a 
direct and detailed picture of the deviations or fluctuations of Sn around its typical value. For the Gaussian 
sample mean, for example, J(s) is a parabola because the fluctuations of Sn around its typical value (the mean 
/i) are Gaussian-distributed. For the exponential sample mean, by contrast, J{s) has the form of a parabola 
only around /i, so that only the small fluctuations of 5„ near its typical value are Gaussian-distributed. The 
large positive fluctuations of Sn that are away from its typical value are not Gaussian; in fact, the form of 
J{s) shows that they are exponentially-distributed because J{s) is asymptotically linear as s ^ cxd. This 
distinction between small and large fluctuations explains the "large" in "large deviation theory", and will be 



studied in more detail in the next section when discussing the Central Limit Theorem. For now, we turn to 
another example that shows that large deviation approximations also arise in the context of random vectors. 

Example II.4 (Symbol frequencies). Let to = {uji,u>2, • • • , ^n) be a sequence of IID random variables 
drawn from the set A = {1,2, . . . ,q} with common probability distribution P{LOi = j) = pj > 0. For a 
given sequence lo, we denote by Ln,j{u)) the relative frequency with which the number or symbol j G A 
appears in u, that is, 

1 " 
Lnj{u:) = -^5^^j, (13) 

where 5ij is the Kronecker symbol. For example, if A = {1, 2, 3} and uj = (1,3,2,3,1, 1), then 

3 12 

Lq,i{u)) = -, Lfi,2{^) = -, L6,3(^) = ^- (14) 

ODD 

The normalized vector^ 

Ln{id) = {Ln,l{u;),Ln,2{uj), ..., Ln,q{uj)) (15) 

containing all the symbol frequencies is called the empirical vector associated with uj { ] . It is also called 
the type of uj in information theory [44] or the statistical distribution of uj in physics. The name "distribution" 
arises because Ln{u!) has all the properties of a probability distribution, namely, < Ln.j{uj) < 1 for all 
j G A, and 

^L„,j(a;) = l (16) 

for all u; G A". It is important to note, however, that L„ is not a probability; it is a random vector associated 
with each possible sequence or configuration uj, and distributed according to the multinomial distribution 

As in Example II. 1, we can extract from this exact result a large deviation approximation by using Stirling's 
approximation. The result for large values of n is 

P(L„ = 1)^ e-^^-W, /p(0 = J2 h li^ -• (18) 

3=1 P^ 

The function Ip{l) is called the relative entropy or Kullback-Leibler distance between the probability 
vectors / and p [49]. As a rate function, Ip{l) is slightly more complicated than the rate functions encountered 
so far, although it shares similar properties. It can be shown, in particular, that Ip{l) is positive and convex, 
and has a single minimum and zero located at / = p, that is, Ij = pj for all j G A (see Chap. 2 of [ ]). As 
before, the zero of the rate function is interpreted as the most probable value of the random variable for which 
the large deviation result is obtained. This applies for Ln because P{Ln = /) converges to exponentially 
fast with n for all / ^ p, since Ip{l) > for all / 7^ p. The only value of L„ for which P(L„ = /) does not 
converge exponentially to is / = p. Hence L„ must converge to p in probability as n ^ cxd. 

The next and last example of this section is a simple and classical one in statistical mechanics. It is 
presented to show that exponential approximations similar to large deviation approximations can be defined 
for quantities other than probabilities, and that entropy functions are large deviation rate functions in disguise. 
We will return to these observations, and in particular to the association "entropy = rate function", in Sec. V. 



' Vectors are not written in boldface. Tiie vector nature of a quantity should be clear from the context in which it appears. 
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Example II.5 (Entropy of non-interacting spins). Consider n spins ai,a2, ■ ■ ■ ,(Tn taking values in the 

set {—1, 1}. It is well known that the number ^{m) of spin configurations a = (cJi, (T2, . . . , o"„) having a 
magnetization per spin 

n 

^-. (19) 



n 






equal to m is given by the binomial-like formula 

Til 

^^""^ " [(l-m)n/2]![(l+m)n/2]!- ^^^^ 

The similarity of this result with the one found in the example about random bits should be obvious. As 
in that example, we can use Stirling's approximation to obtain a large deviation approximation for Q{m), 
which we write as 

r-./ ^ ns(m) /^ 1-ml-m 1+ml + m r-i-ii /^ix 

17(m)«e"^^™^ s{m) = ^ 1" ^ 2~^^~' "^^[-^'^l- ^^1) 

The function s{m) is the entropy associated with the mean magnetization. 

As in the previous example, we can also count the number Q{1) of spin configurations containing a relative 
number /+ of +1 spins and a relative number /_ of —1 spins. These two relative numbers or frequencies are 
the components of the two-dimensional empirical vector I = (/-|-, L), for which we find 

^{l) « e'""'(^) , s{l) = -l+ In 1+ - /_ In l_ (22) 

for n large. The function s{l), which plays the role of a rate function, is also called the entropy, although it is 
now the entropy associated with the empirical vector Notice that since we can express m as a function of / 
and vice versa, s{m) can be expressed in terms of s{l) and vice versa. 

III. LARGE DEVIATION THEORY 

The cornerstone of large deviation theory is the exponential approximation encountered in the previous 
examples. This approximation appears so frequently in problems involving many random variables, in 
particular those studied in statistical mechanics, that we give it a name: the large deviation principle. Our 
goal in this section is to lay down the basis of large deviation theory by first defining the large deviation 
principle with more care, and by then deriving a number of important consequences of this principle. In 
doing so, we will see that the large deviation principle is similar to the laws of thermodynamics, in that a few 
principles — a single one in this case — can be used to derive many far-reaching results. No attempt will be 
made in this section to integrate or interpret these results within the framework of statistical mechanics; this 
will come after Sec. IV. 



A. The large deviation principle 

A basic approximation or scaling law of the form Pn ~ e~"^, where P„ is some probability, n a parameter 
assumed to be large, and / some positive constant, is referred to as a large deviation principle. Such a 
definition is, of course, only intuitive; to make it more precise, we need to define what we mean exactly by 
Pn and by the approximation sign "ss". This is done as follows. Let An be a random variable indexed by the 
integer n, and let P{An G B) be the probability that An takes on a value in a set B. We say that P{An £ B) 
satisfies a large deviation principle with rate Ib if the limit 

lim --In P{An eB)=lB (23) 

n— >oo n 
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exists. 

The idea behind this limit should be clear. What we mean when writing P(A„ £ B) ^ e""^^ is that the 
dominant behavior of P{An £ B) is a. decaying exponential in n. Using the small-o notation, this means 
that 

- In P{An eB)= niB + o{n) , (24) 

where Ib is some positive constant. To extract this constant, we divide both sides of the expression above by 
n to obtain 

--lnP{An£B) = lB + o{l), (25) 

n 

and pass to the limit n — > oo, so as to get rid of the o(l) contribution. The end result of these steps is the 
large deviation limit shown in (23). Hence, if P{An G B) has a dominant exponential behavior in n, then 
that limit should exist with Ib 7^ 0. If the limit does not exist, then either P{An G B) is too singular to have 
a limit or else P{An G B) decays with n faster than e^"" with a > 0. In this case, we say that P{An G B) 
decays super-exponentially and set / = 00. The large deviation limit may also be zero for any set B if 
P{An G B) is sub-exponential in n, that is, if P{An G B) decays with n slower than e"""^, a > 0. The 
cases of interest for large deviation theory are those for which the limit shown in (23) does exist with a 
non-trivial rate exponent, i.e., different from or cxd. 

All the examples studied in the previous section fall under the definition of the large deviation principle, 
but they are more specific in a way because they refer to particular events of the form An = a rather than 
An G B. In the case of the random bits, for example, we found that the probability P{Rn = r) satisfied 

lim -- \nP{Rn = r) = I{r), (26) 

with /(r) a continuous function that we called in this context a rate function. Similar results were obtained for 
the Gaussian and exponential sample means, although for these we worked with probability densities rather 
than probability distributions. The "density" large deviation principles that we obtained can nevertheless be 
translated into "probabihty" large deviation principles simply by exploiting the fact that 

P{Sn e[s,S + ds]) = p{Sn = S) ds, (27) 

where p{Sn = s) is the probability density of Sn, in order to write 

P(Sn G [s, s + ds]) ^ e-"^(") ds. (28) 

Proceeding with P{Sn G [s, s + ds]), the rate function J(s) is then recovered, as in the case of discrete 
probability distributions, by taking the large deviation limit. Thus 

lim -- \nP{Sn G [s, s + ds]) = J[s) + lim - Inds = J[s), (29) 

71— >oo n n^oo n 

where the last equality follows by assuming that ds is an arbitrary but non-zero infinitesimal element. 

B. More on the large deviation principle 

The limit defining the large deviation principle, as most limits appearing in this review, should be 
understood at a practical rather than rigorous level. Likewise, our definition of the large deviation principle 
should not be taken as a rigorous definition. In fact, it is not. In dealing with probabilities and limits, there are 
many mathematical subtleties that need to be taken into account (see Appendix B). Most of these subtleties 
will be ignored in this review, but it may be useful to mention two of them: 
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• The limit involved in the definition of the large deviation principle may not exist. In this case, one may 
still be able to find an upper bound and a lower bound on P{An G B) that are both exponential in n: 

^-ni- < p^^^ eB) < e-"^s. (30) 

The two bounds give a precise meaning to the statement that P{An G B) is decaying exponentially 
with n, and give rise to two large deviation principles: one defined in terms of a "limit inferior" 
yielding /^, and one defined with a "limit superior" yielding I^. This approach, which is the one 
followed by mathematicians, is described in Appendix B. For the purposes of this review, we make 
the simplifying assumption that /^ = I^ always holds; hence our definition of the large deviation 
principle involving a simple limit. 

• Discrete random variables are often treated as if they become continuous in the limit n —>■ oo. Such 
a "discrete to continuous" limit, or continuum limit as it is known in physics, was implicit in many 
examples of the previous section. In the first example, for instance, we noted that the proportion Rn 
of I's in a random bit sequence of length n could only assume a rational value. As n ^ oo, the set of 
values of i?„ becomes dense in [0, 1], so it is useful in this case to picture i?„ as being a continuous 
random variable taking values in [0, 1]. Likewise, in Example II. 5 we implicitly treated the mean 
magnetization ?n, as a continuous variable, even though it assumes only rational values forn < cxd. In 
both examples, the large deviation approximations that we derived were continuous approximations 
involving continuous rate functions. 

The replacement of discrete random variables by continuous random variables is justified mathematically 
by the notion of weak convergence. Let An be a discrete random variable with probability distribution 
P{An = a) defined on a subset of values a G M, and let An be a continuous random variable with probability 
density p{An) defined on M. To say that An converges weakly to An means, essentially, that any sum 
involving An can be approximated, for n large, by integrals involving An, i.e., 

Y, f{a)P{An = a) " ~" / f{a) p(i„ = a) da, (31) 

where / is any continuous and bounded function defined over M. This sort of approximation is common in 
physics, and suggests the following replacement rule: 

P[An = a)^ p(An = a) da (32) 

as a formal device for taking the continuum limit of An- For more information on the notion of weak 
convergence, the reader is referred to [ , ] and Appendix B of this review. 

Most of the random variables considered in this review, and indeed in large deviation theory, are either 
discrete random variables that weakly converge to continuous random variables or are continuous random 
variables right from the start. To treat these two cases with the same notation, we will try to avoid using 
probability densities whenever possible, to consider instead probabilities of the form P{An G [a,a + da]). 
To further cut in the notations, we will also avoid using a tilde for distinguishing a discrete random variable 
from its continuous approximation, as done above with An and An- From now on we thus write 

P[An e[a,a + da]) ^ e'^^^'^^da. (33) 

to mean that An, whether discrete or continuous, satisfies a large deviation principle. This choice of notation 
is convenient but arbitrary: readers who prefer probability densities may express a large deviation principle 
for An in the density form p{An = a) ss q-'^^w instead of the expression shown in (33). In this way, one 
need not bother with the infinitesimal element da in the statement of the large deviation principle. In this 
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review, we will use the probability notation shown in (33), which has to include the infinitesimal element da, 
even though this element is not exponential in n. Indeed, without the element da, the following expectation 
value would not make sense: 

if (An)) = I f{a) P{An e [a, a + da]) X y /(a) e'-^^'^) da. (34) 

There are two final pieces of notation that need to be introduced before we go deeper into the theory of 
large deviations. First, we will use the more compact expression P{An E da) to mean P{An G [a,a + da]). 
Next, we will follow Ellis [85] and use the sign ">c" instead of "w" whenever we treat large deviation 
principles. In the end, we thus write 

P{An e da) X e-"^(") da (35) 

to mean that An satisfies a large deviation principle, in the sense of (23), with rate function /(a). The sign 
"x" is used to stress that, as n ^ oo, the dominant part of P(A„ G da) is the decaying exponential Q-^^i"-). 
We may also interpret the sign "x" as expressing an equality relationship on a logarithmic scale; that is, we 
may interpret a„ x bn as meaning that 

1 1 

lini — lna„= lini — ln6„. (36) 

71— >oo 77, n— >oo 77, 

We say in this case that a„ and 6„ are equal up to first order in their exponents [49]. 

C. Calculating rate functions 

The theory of large deviations can be described from a practical point of view as a collection of methods 
that have been developed and gathered together in one toolbox to solve two problems [53]: 

• Establish that a large deviation principle exists for a given random variable; 

• Derive the expression of the associated rate function. 

Both of these problems can be addressed, as we have done in the examples of the previous section, by 
directly calculating the probability distribution of a random variable, and by deriving from this distribution 
a large deviation approximation using Stirling's approximation or other asymptotic formulae. In general, 
however, it may be difficult or even impossible to derive large deviation principles through this direct 
calculation path. Combinatorial methods based on Stirling's approximation cannot be used, for example, 
for continuous random variables, and become quite involved when dealing with sums of discrete random 
variables that are non-llD. For these cases, a more general calculation path is provided by a fundamental 
result of large deviation theory known as the Gartner-Ellis Theorem [ ^3, 1 17]. What we present next is a 
simplified version of that theorem, which is sufficient for the applications covered in this review; for a more 
complete presentation, see Sec. 5 of [85] and Sec. 2.3 of [53]. 



7. The Gartner-Ellis Theorem 

Consider a real random variable An parameterized by the positive integer n, and define the scaled 
cumulant generating function of An by the limit 

A(A;) = lim -ln/e"'=^"V (37) 

n^oo n \ I 
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where A; G R and 

afeA„\ /'e"'^»P(^„eda). (38) 

/ Jr 

The Gartner-ElUs Theorem states that, if A(A;) exists and is differentiable for all fc G M, then An satisfies a 
large deviation principle, i.e., 

P{An e da) X e-"^(") da, (39) 

with a rate function /(a) given by 

I{a)=sup{ka-X{k)}. (40) 

fceiR 

The symbol "sup" above stands for "supremum of", which for us can be taken to mean the same as "maximum 
of". The transform defined by the supremum is an extension of the Legendre transform referred to as the 
Legendre-Fenchel transform [238]. The Gartner-Ellis Theorem thus states in words that, when the scaled 
cumulant generating function X{k) of An is differentiable, then An obeys a large deviation principle with a 
rate function I{a) given by the Legendre-Fenchel transform of A(A;). 

The next sections will show how useful the Gartner-Ellis Theorem is for calculating rate functions. It is 
important to know, however, that not all rate functions can be calculated with this theorem. Some examples of 
rate functions that cannot be calculated as the Legendre-Fenchel transform of \{k), even though A(A;) exists, 
will be studied in Sec. IV D. The argument presented next is meant to give some insight as to why I{a) can 
be expressed as the Legendre-Fenchel transform of A(A;) when \{k) is differentiable. A full understanding of 
this argument will also come in Sec. IV D. 

2. Plausibility argument for the Gartner-Ellis Theorem 

Two different derivations of the Gartner-Ellis Theorem are given in Appendix C. To gain some insight 
into this theorem, we derive here the second part of this theorem, namely Eq. (40), by assuming that a large 
deviation principle holds for An, and by working out the consequences of this assumption. To start, we thus 
assume that 

P{An G da) X e-"^(") da, (41) 

and insert this approximation into the expectation value defined in Eq. (38) to obtain 

' Jr 

Next, we approximate the integral by its largest integrand, which is found by locating the maximum of ka — 
/(a). This approximation, which is known as the saddle-point approximation or Laplace's approximation^, 
is a natural approximation to consider here because the error associated with it is of the same order as the 
error associated with the large deviation approximation itself. Therefore, assuming that the maximum of 
ka — I{a) exists and is unique, we write 

^nkAA _ g^p ( nsupjfca - I {a)}] (43) 



^ The saddle-point approximation is used in connection with integrals in the complex plane, whereas Laplace's approximation or 
Laplace's method is used in connection with real integrals (see Chap. 6 of [ . ^ ]). 
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and so 

A(A;) = lim - In /e"'=^"\ = sup{A;a - I (a)}. (44) 

To obtain /(a) in terms of A(A;), we then use the fact that Legendre-Fenchel transforms can be inverted when 
X{k) is everywhere differentiable (see Sec. 26 of [ ]). In this case, the Legendre-Fenchel transform is 
self-inverse (we also say involutive or self-dual), so that 

I{a)=snv{ka-X{k)], (45) 

km. 

which is the result of Eq. (40). 

This heuristic derivation illustrates two important points about large deviation theory. The first is that 
Legendre-Fenchel transforms appear into this theory as a natural consequence of Laplace's approximation. 
The second is that the Gartner-Ellis Theorem is essentially a consequence of the large deviation principle 
combined with Laplace's approximation. This point is illustrated in Appendix C, and will be discussed again 
in the context of another important result of large deviation theory known as Varadhan's Theorem. 

D. Cramer's Theorem 

The application of the Gartner-Ellis Theorem to a sample mean 

n 

Sn = -y^Xi (46) 

of independent and identically distributed (IID) random variables yields a classical result of probability 
theory known as Cramer's Theorem [50]. In this case, the scaled cumulant generating function has the simple 
form 

1 1 " 

A(A;) = lim - In U^ ^-i ^A = lim - In TT U^^^ \ = In /e'=^\ , (47) 

i=\ 

where X is any of the summands Xi. As a result, one derives a large deviation principle for Sn simply by 
calculating the cumulant generating function \a.(^^^) of a single summand, and by taking the Legendre- 
Fenchel transform of the result. The next examples illustrate these steps. Note that the differentiability 
condition of the Gartner-Ellis Theorem need not be checked for IID sample means because the generating 
function or Laplace transform {e'^^) of a random variable X is always real analytic when it exists for all 
keR (see Theorem V11.5. 1 of [ ]). 

Example III.l (Gaussian sample mean revisited). Consider again the sample mean Sn of n Gaussian IID 
random variables considered in Example 11.2. For the Gaussian density of Eq. (5), X{k) is easily evaluated to 
be 

X{k) = In / e''^ \ = fik + -a^k^, keR. (48) 

As expected, X{k) is everywhere differentiable, so that P{Sn G ds) x e"*^^*^^^ ds with 

I{s) = sup{ks - X{k)}. (49) 

k 

This recovers Cramer's Theorem. The supremum defining the Legendre-Fenchel transform is solved directly 
by ordinary calculus. The result is 

I{s) = k{s)s - X{k{s)) = ^"""^^ , seR, (50) 
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where k{s) is the unique maximum point of ks — X{k) satisfying X'{k) = s. This recovers exactly the result 
of Example II.2 knowing that P(5„ G ds) = p{Sn = s)ds. 

Example III.2 (Exponential sample mean revisited). The calculation of the previous example can be 
canied out for the exponential sample mean studied in Example II.3. In this case, we find 

\{k) = -\n{l- ^lk), k<\lii. (51) 

From Cramer's Theorem, we then obtain -P(5„ G ds) x e""^*^*) ds, where 

I(s) =sup{/fcs-A(/fc)} = A;(s)s-A(A;(s)) = --1-ln-, s > 0, (52) 

in agreement with the result announced in (12). It is interesting to note here that the singularity of A(fc) at 
1//X translates into a branch of I(s) which is asymptotically linear. This branch of /(s) translates, in turn, 
into a tail of Pi^Sn G ds) which is asymptotically exponential. If the probability density of the IID random 
variables is chosen to be a double-sided rather than a single-sided exponential distribution, then both tails of 
PiSn G ds) become asymptotically exponential. 

We will study other examples of IID sums, as well as sums involving non-IID random variables in Sec. IV. 
It should be clear at this point that the scope of the Gartner- Ellis Theorem is not limited to IID random 
variables. In principle, the theorem can be applied to any random variable, provided that one can calculate the 
limit defining A(/c) for that random variable, and that A(A;) satisfies the conditions of the theorem. Examples 
of sample means of random variables for which A(/i;) fail to meet these conditions will be presented also in 
Sec. IV. 

E. Properties of A and / 

We now state and prove a number of properties of scaled cumulant generating functions and rate functions 
in the case where the latter is obtained via the Gartner-Ellis Theorem. The properties listed hold for an 
arbitrary random variable An under the conditions stated, not just sample means of IID random variables. 

1. Properties of \at k — 
Since probability measures are normalized, A(0) = 0. Moreover, 



A'(0) = lim 



= lim {An), (53) 

n— >oo 
fc=0 



n^oo (p'nkAn\ 

provided that A'(0) exists. For IID sample means, this reduces to A'(0) = {X) = ^i; see Fig. 4(a). Similarly, 
A"(0) = lim n [{AD - {A^f) = lim nvar(A), (54) 

n— +00 ' n— »oo 

which reduces to A"(0) = var(X) = a"^ for IID sample means. 



2. Convexity of A 
The function \{k) is always convex. This comes as a general consequence of Holder's inequality: 
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(b) 



l'(0)=/i 



\ slop:=A:(a) ^(«) 




slope =a(^) 



FIG. 4: (a) Properties of A(fc) at A; = 0. (b) Legendre duality: the slope of A at fc is the point at which the slope of / is 

k. 

where < p, g < 1, p + g = 1. Applying this inequality to \{k) yields 

aln/e"'^!^"^ + (1 - a)ln/e"^2A„\ > ^^ / n[afci+(i-a)fc2]A„\ (g^^ 

for a G [0, 1]. Hence, 

a\{ki) + (1 - a)\{k2) > A {aki + (1 - a)/c2) (57) 

A particular case of this inequality, which defines a function as being convex [''^l^'], is A(A;) > /i;A'(0) = k^; 
see Fig. 4(a). Note that the convexity of \{k) directly implies that \{k) is continuous in the interior of its 
domain, and is differentiable everywhere except possibly at a denumerable number of points [238, 272]. 

3. Legendre transform and Legendre duality 

We have seen when calculating the rate functions of the Gaussian and exponential sample means that the 
Legendre-Fenchel transform involved in the Gartner-Ellis Theorem reduces to 



I[a) = k[a)a — X{k{a)), 



(58) 



where k{a) is the unique root of A'(fc) = a. This equation plays a central role in this review: it defines, as is 
well known, the Legendre transform of A(A;), and arises in the examples considered before because A(A;) is 
everywhere differentiable, as required by the Gartner-Ellis Theorem, and because \{k) is convex, as proved 
above. These conditions — differentiability and convexity — are the two essential conditions for which the 
Legendre-Fenchel transform reduces to the better known Legendre transform (see Sec. 26 of [ ]). 

An important property of Legendre transforms holds when X{k) is differentiable and is strictly convex, 
that is, convex with no linear parts. In this case, X'{k) is monotonically increasing, so that the function k{a) 
satisfying X'{k{a)) = a can be inverted to obtain a function a{k) satisfying A'(A;) = a{k). From the equation 
defining the Legendre transform, we then have I'{a{k)) = k and I'{a) = k{a). Therefore, in this case — and 
this case only — the slopes of A are one-to-one related to the slopes of /. This property, which we refer as the 
duality property of the Legendre transform, is illustrated in Fig. 4(b). 

The next example shows how border points where X{k) diverges translate, by Legendre duality, into 
branches of I{a) that are linear or asymptotically linear.^ A specific random variable for which this duality 
behavior shows up is the sample mean of exponential random variables studied in Example in.2. Since we 
can invert the roles of X{k) and /(a) in the Legendre transform, this example can also be generalized to show 
that points where /(a) diverges are associated with branches of X{k) that are linear or asymptotically linear; 



' Recall that, because A(fc) is a convex function, it cannot have diverging points in the interior of its domain. 
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FIG. 5: (a) Scaled cumulant generating function \{}i) defined on the open domain (fc;, fc/j), with diverging slopes at 
the boundaries, (b) The Legendre transform /(a) of A(A:) is asymptotically linear as |/c| ^> cx3. The asymptotic slopes 
correspond to the boundaries of the region of convergence of A(fc). (c) A(fc) is defined on (fc; , fc/j) as in (a) but has 
finite slopes at the boundaries, (d) Legendre-Fenchel transform /(a) of the function A(fc) shown in (c). The function 
I{a) has branches that are linear rather than just asymptotically linear, with slopes corresponding to the boundaries of 
the region of convergence of A(fc). 



see Example II. 1 . These sorts of diverging points and linear branches arise often in physical applications, for 
example, in relation to nonequilibrium fluctuations; see Sec. VIC. 

Example III.3. Consider the scaled cumulant generating function A(A;) shown in Fig. 5(a). This function 
has the particularity that it is defined only on a bounded (open) interval (A;;, kh), and has diverging slopes 
at the boundaries, that is, A'(A;) — > oo as /c approaches k^^ from below and A'(A;) — > — oo as k approaches 
ki from above. To determine the shape of the Legendre transform of A(A;), which corresponds to the rate 
function /(a) associated with A(/i;) (assume that A(A;) is everywhere differentiable), we simply need to use 
Legendre duality. On the one hand, since the slope of A(fc) diverges as k approaches k^, the slope of /(a) 
must approach the constant fc/^ as a ^ oo (remember that slopes of A are abscissas of /). On the other hand, 
since the slope of A(A;) goes to — oo as k approaches ki, the slope of /(a) must approach the constant ki as 
a —>■ — oo. Overall, /(a) is thus asymptotically linear; see Fig. 5(b). 

Now suppose that rather than having diverging slopes at the boundaries ki and k^, X{k) has finite slopes 
ai and ah, respectively; see Fig. 5(c). What is the rate function /(a) associated with this form of A(A;)? 
The answer, surprisingly, is that there is not one but many rate functions that may correspond to this X{k). 
One such rate function is the Legendre-Fenchel transform of \{k) shown in Fig. 5(d). This function has 
the particularity that it has two linear branches which arise, as before, because of the two boundary points 
of A(A;). The difference here is that these branches are really linear, and not just asymptotically linear, 
because the left-derivative of X{k) at k^ is finite, and so is its right-derivative at ki. To understand why 
these linear branches appear, one must appeal to a generalization of Legendre duality involving the concept 
of "supporting lines" [ ]. We will not discuss this concept here; suffice it to say that the value of the 
left-derivative of X{k) at kh corresponds to the starting point of the linear branch of /(a) with slope kh- 
Similarly, the right-derivative of A(A;) at ki corresponds to the endpoint of the linear branch of /(a) with 
slope ki. 
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The reason why the rate function shown in Fig. 5(d) is but one candidate rate function associated with the 
X{k) shown in Fig. 5(c) is explained in Sec. IV D. The reason has to do, essentially, with the fact that A(A;) is 
nondifferentiable at its boundaries. In large deviation theory, one says more precisely that X{k) is non-steep; 
see the notes at the end of this section for more information about this concept. 



4. Varadhan 's Theorem 

In our heuristic derivation of the Gartner-Ellis Theorem, we showed that if An satisfies a large deviation 
principle with rate function /(a), then A(A;) is the Legendre-fenchel transform of I{a): 

\{k) = lim - U'^^^A = sup{A:a - 1(a)}. (59) 

n^oo n \ I a 

Replacing the product kAn by an arbitrary continuous function / of An yields the more general result 



A(/) = lim -ln/e"^(^"A =sup{/(a) -/(a)}, 



(60) 

n->oo n \ la 

which is known as Varadhan's Theorem [ ]. The function A(/) thus defined is afunctional of /, as it is a 
function of the function /. 

As we did for the result shown in (59), we can justify (60) as a consequence of the lai^ge deviation 
principle for An and Laplace's approximation. It is important to note, however, that Varadhan's Theorem 
is a consequence of Laplace's approximation only when An is a real random variable; for other types of 
random variables, such as random functions, Varadhan's Theorem still applies, and so extends Laplace's 
approximation to these random variables. Varadhan's Theorem also holds when /(a) — I{a) has more 
than one maximum, that is, when the integral defining the expected value (e"-^^^"^) has more than one 
saddle -point. We will come back to this point in Sec. IV when discussing nonconvex rate functions, and 
again in Sec. V when discussing nonconcave entropies. 

5. Positivity of rate functions 

Rate functions are always positive. This follows by noting that A(0) = and that X{k) can always be 
expressed as the Legendre-Fenchel transform of I {a). Hence, 

A(0) = sup{-/(a)} = - inf I{a) = 0, (61) 

a °- 

where "inf" denotes the "infimum of. A negative rate function would imply that P{An G da) diverges as 

n — > oo. 



6. Convexity of rate functions 

Rate functions obtained from the Gartner-Ellis Theorem are necessarily strictly convex, that is, they are 
convex and have no linear parts.^ That Legendre-Fenchel transforms yield convex functions is easily proved 
from the definition of these transforms [11 1\. To prove that they yield strictly convex functions when A(A;) is 
differentiable is another matter; see, e.g.. Sec. 26 of [ _ ]. As a special case of interest, let us assume that 



'' This does not mean that all rate functions are strictly convex — only that those obtained from the Gartner-Ellis Theorem are 
strictly convex. 
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(a) 



(b) 





FIG. 6: (a) Example of a unimodal probability density p„(a) shown for increasing values of n (black line), and its 
corresponding convex rate function I (a) (red line), (b) Example of a bimodal probability density p„(a) shown for 
increasing values of n characterized by a nonconvex rate function I{a) having a local minimum in addition to its global 
minimum. 

X{k) is differentiable and has no linear parts, as in our discussion of the Legendre duality property. In this 
case, the Legendre-Fenchel transform reduces to a Legendre transform, as noted earlier, and the equation 
defining the Legendre transform then implies 



I" (a) = k\a) 



1 



X"{k) 



(62) 



Since X{k) is convex with no linear parts (A"(/c) > 0), I{a) must then also be convex with no linear parts 
{I" (a) > 0). This shows, incidentally, that the curvature of /(a) is the inverse curvature of \{k). In the case 
of IID sample means, in particular. 



I" {a = fi) 



1 



1 



A"(0) 



a 



2' 



(63) 



A similar result holds for non-IID random variables by replacing a^ with the general result of Eq. (54). 



7. Law of Large Numbers 



If I {a) has a unique global minimum and zero a*, then 

a* = A'(0) = lim (An). 



(64) 



by Eq. (53). If /(a) is differentiable at a*, we further have I' {a*) = k{a*) = 0. To prove this property, 
simply apply the Legendre duality property: 



I{a*) = k{a*)a* - \{k{a*)) = • a* - = 0. 



(65) 



The global minimum and zero of I {a) has a special property that we noticed already: it corresponds, 
if it is unique, to the only value at which P{An G da) does not decay exponentially, and so around which 
P{An G da) gets more and more concentrated as n — > oo; see Fig. 6(a). Because of the concentration effect, 
we have 



lim P{An G da*) = lim P(A„ G [a*, a* + da]) = 1, 



(66) 



as noted already in Eq. (10), and so we call a* the most probable or typical value of A„. The existence of 
this typical value is an expression of the Law of Large Numbers, which states in its weak form that An -^ a* 
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with probability 1 . An important observation here is that large deviation theory extends the Law of Large 
Numbers by providing information as to how fast An converges in probability to its mean. To be more 
precise, let B be any set of values of A.^. Then 

P{An ^B)= f P{An G da) X / e-"^^'^) da x ^-mm^^Biia) (67) 

J B Jb 

by applying Laplace's approximation. Therefore, P{An ^ B) —^ exponentially fast with n if a* ^ B, 
which means that P(A„ G S) ^ 1 exponentially fast with n if a* G B. 

In general, the existence of a Law of Large Numbers for a random variable An is a good sign that a large 
deviation principle holds for An- In fact, this law can often be used as a point of departure for deriving large 
deviation principles; see [ 15, 216] and Appendix C. It should be emphasized, however, that /(a) may have 
more than one global minimum, in which case the Law of Large Numbers may not hold. Rate functions may 
even have local minima in addition to global ones. The global minima yield typical values of An just as in 
the case of a single minimum, whereas the local minima yield what physicists would call "metastable" values 
of An at which P( A„ G da) is locally but not globally maximum; see Fig. 6(b). Physicists would also call a 
typical value of An, determined by a global minimum of /(a), an "equilibrium state". We will come to this 
language in Sec. V. 

8. Gaussian fluctuations and the Central Limit Theorem 

The Central Limit Theorem arises in large deviation theory when a convex rate function /(a) possesses 
a single global minimum and zero a* , and is twice differentiable at a*. Approximating /(a) with the first 
quadratic term, 

I{a)^h'\a*){a-a*)\ (68) 

then naturally leads to the Gaussian approximation 

P{An G da) ^ Q~nI"{a*){a-a*f/2 ^^^ (gg) 

which can be thought of as a weak form of the Central Limit Theorem. More precise results relating the 
Central Limit Theorem to the large deviation principle can be found in [31, 201]. We recall that for sample 
means of IID random variables, I"{a*) = 1/A"(0) = l/cr^; see Sec. 111E6. 

The Gaussian approximation displayed above can be shown to be accurate for values of An around a* of 
the order 0{n^^/'^) or, equivalently, for values ofnAn around a* of the order 0{v}/'^). This explains the 
meaning of the name "large deviations". On the one hand, a small deviation of An is a value An = a for 
which the quadratic expansion of /(a) is a good approximation of /(a), and for which, therefore, the Central 
Limit Theorem yields essentially the same information as the large deviation principle. On the other hand, a 
large deviation is a value An = a for which /(a) departs sensibly from its quadratic approximation, and 
for which, therefore, the Central Limit Theorem yields no useful information about the large fluctuations 
of An away from its mean. In this sense, large deviation theory can be seen as a generalization of the 
Central Limit Theorem characterizing the small as well as the large fluctuations of a random variable. Large 
deviation theory also generalizes the Central Limit Theorem whenever /(a) exists but has no quadratic Taylor 
expansion around its minimum; see Examples V.4 and V.6. Note finally that having a Central Limit Theorem 
for An does not imply that /(a) has a quadratic minimum. A classic counterexample is presented next. 

Example III.4 (Sample mean of double-sided Pareto random variables). Let Sn be a sample mean of n 
IID random variables Xi,X2,. . . , Xn distributed according to the so-called Pareto density 
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with /3 > 3, c a real, positive constant, and A a normalization constant. Since the variance of the summands 
is finite for /? > 3, the Central Limit Theorem holds for n^^'^Sn- Yet it can be verified that the rate function 
of Sn is everywhere equal to zero because the probability density of Sn has power-law tails similar to those 
oip{x) [168]. Note also that the scaled generating function A(A;) is diverging for all fc G M except A; = 0. 

We will study in the next section another example of sample mean involving a power-law probability 
density similar to the Pareto density. This time, the power-law density will be one-sided rather than 
double-sided, and the rate function will be seen to be different from zero for some values of the sample mean. 

F. Contraction principle 

We have seen at this point two basic results of large deviation theory. The first is the Gartner-Ellis 
Theorem, which can be used to prove that a large deviation principle exists and to calculate the associated 
rate function from the knowledge of \{k). The second result is Varadhan's Theorem, which can be used 
to calculate A(A;) from the knowledge of a rate function. The last result that we now introduce is a useful 
calculation device, called the contraction principle [68], which can be used to calculate a rate function from 
the knowledge of another rate function. 

The problem addressed by the contraction principle is the following. We have a random variable A„ 
satisfying a large deviation principle with rate function Ia{cl), and we want to find the rate function of another 
random variable i?„ such that Bn = h{An), where his a continuous function. We call h a contraction of 
An, as this function may be many-to-one. To calculate the rate function of Bn from that of An, we simply 
use the large deviation principle for An and Laplace's approximation at the level of 



P{Bn £db)= [ P{An £ da) 

J\a:h{a)=b\ 



(71) 

' {a:h{a)=b} 

to obtain 

P{Bn G db) X exp ( -n inf /A(a) ) da. (72) 

y a:h{a)=b J 

This shows that if a large deviation principle holds for An with rate function lAia), then a large deviation 
principle also holds for Bn, 

P(5„Gd6)xe-"^s(^)d6, (73) 

with a rate function given by 

lB{b)= inf lA{a). (74) 

a:h{a)=b 

This general reduction of one rate function to another is what is called the contraction principle. If /i is a 
bijective function with inverse h~^, then /_b(6) = /yi(/i~^(6)). Note also that /_b(6) = cxd if there is no value 
a such that h{a) = b, i.e., if the pre-image of b is empty. 

The interpretation of the contraction principle should be clear. Since probabilities in large deviation 
theory are measured on the exponential scale, the probability of any large fluctuation should be approximated, 
following Laplace's approximation, by the probability of the most probable (although improbable) event 
leading or giving rise to that fluctuation. We will see many applications of this idea in the next sections, 
including a derivation of the maximum entropy principle based on the contraction principle. The "least 
improbable" event underlying or leading to a large deviation — be it a "state" underlying a large deviation or 
a "path" leading to that deviation — is often referred to as a dominating or optimal point [.i2, 212]. 
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G. Historical notes and furtlier reading 

Large deviation theory emerged as a general theory during the 1960s and 1970s from the independent 
works of Donsker and Varadhan [65, 66, 67, 68, 277], and Freidlin and Wentzell [106]. Prior to that period, 
large deviation results were known, but there was no unified and general framework that dealt with them. 
Among these results, it is worth noting Cramer's Theorem [ ], Chebyshev's inequality ["~], Sanov's 
Theorem [ ], which had been anticipated by Boltzmann [ ] (see [ ]), as well as extensions of Cramer's 
Theorem obtained by Lanford [ I f-^^], Bahadur and Zabell [ ], and by Plachky and Steinebach [ ]. Sanov's 
Theorem was already encountered in the introductory examples of Sec. II, and will be treated again in 
the next section. What statisticians call saddle-point approximations (see, e.g., [9, 33, 5 ]) are also large 
deviation results for the probability density of sample means; see Appendix C. For more information on the 
development of large deviation theory, see the historical notes found in [32, 53, 53] as well as in Sec. VII.7 
of [84]. 

The Gartner-Ellis Theorem is the product of a result proved by Gartner [ ' ' ^], which was later generalized 
by Ellis [ ] . The work of Ellis [ ] explicitly refers to the construction of the large deviation principle 
currently adopted in large deviation theory (see Appendix B), which stems from the work of Varadhan [277]. 

As noted before, the statement of the Gartner-Ellis Theorem given here is a simplification of that theorem. 
In essence, the result that we have stated and used is that of Gartner [ " ]; it is less general but less technical 
than the result proved by Ellis [ ], which can be applied to cases where X{k) exists and is differentiable 
over some limited interval (so not necessarily the whole line, as in Gartner's result), provided that a technical 
condition, known as the steepness condition, is verified. For a statement of this condition, see Theorem 5.1 
of [85] or Theorem 2.3.6 of [ ]; for an illustration of it, see Examples IV.3 and IV.8 of the next section. 

The statement of Varadhan 's Theorem given here is also a simplification of the original and complete result 
proved by Varadhan [277]; see, e.g.. Theorem 4.3.1 in [53] and Theorem 1.3.4 in [ ]. An example of rate 
function for which the full conditions of Varadhan's Theorem are not satisfied is presented in Example IV.8 
of the next section. 

Introductions to the theory of large deviations similai^ to the one given in this section can be found in 
review papers by Oono [222], Amann and Atmanspacher [ ], Ellis [85, 86], Lewis and Russell [ ], and 
Varadhan [27 ]. Readers who are willing to read mathematical textbooks are encouraged to consult those 
of Ellis [ ], Deuschel and Stroock [ ], Dembo and Zeitouni [ ], and den Hollander [ ] for a proper 
mathematical account of large deviation theory. The main simplifications introduced in this review concern 
the definition of the large deviation principle, and the fact that we do not state large deviation principles 
using the abstract language of topological spaces and measure theory. The precise and rigorous definition of 
the large deviation principle can be found in Appendix B. 

For an accessible introduction to Legendre-Fenchel transforms and convex functions, see the monograph 
of van Tiel [27 ] and Chap. VI of [ ]. The definitive reference on convex analysis is the book by Rockafellar 
[238]. 



IV. MATHEMATICAL APPLICATIONS 

This section is intended to complement the previous section. We review here a number of mathematical 
problems for which large deviation principles can be formulated. The applications were selected to give an 
idea of the generality of large deviation theory, to illustrate important points about the Gartner-Ellis Theorem, 
and to introduce many ideas and results that will be revisited from a more physical point of view in the next 
sections. We also discuss here a classification of large deviation results related from top to bottom by the 
contraction principle. 
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A. Sums of IID random variables 

We begin our review of mathematical applications by revisiting the now familiar sample mean 

n 

Sn = -yXi (75) 



n 



i=l 



involving n IID random variables Xi, X2, . . . , X„. The next three examples consider different cases of 
sample distributions for the Xj's, and derive the corresponding large deviation principle for 5„ using the 
Gartner-Ellis Theorem or, equivalently in this case, Cramer's Theorem. We start with an example closely 
related to the introductory example of Sec. II which was concerned with spins. 

Example IV.l (Binary random variables). Let the n random variables in S'„ be such that P{Xi = — 1) = 
P{Xi = 1) = ^. For this distribution, 

A(A;) = In /e^^» \ = In cosh k, k£R. (76) 

This function is differentiable for all A; € M, as expected, so the rate function I{s) of 5„ can be calculated as 
the Legendre transform of X{k). The result is 

I{s) = ^Hl + s) + ^-^Hl-s), s€[-l,l]. (77) 

The minimum and zero of I(s) is s = 0. 

Surprisingly, not all sample means of IID random variables fall within the framework of Cramer's 
Theorem. Here is an example for which X{k) does not exist, and for which large deviation theory yields in 
fact no useful information. 

Example IV.2 (Symmetric Levy random variables). The class of strictly stable or strict Levy random 
variables that are symmetric is defined by the following characteristic function: 

3'^^\ =e-Tl«l", eeIR,7>0,aG (0,2). (78) 

From this result, it is tempting to make the change of variables i£, = k, often called a Wick rotation, to write 
\{k) = — 7I A;|" for A; G M, but the correct result for k real is actually 

fO ifA: = 
[ cxD Otherwise. 

This follows because the probability density p{x) corresponding to the characteristic function of (78) has 
power-law tails of the form p{x) ~ x~^~" as \x\ —>■ cxd, which implies that (e'^"^) does not converge for 
/c e M \ {0}, although it converges when k is purely imaginary, that is, when A; = i^ with ^ S M. 

From the point of view of large deviation theory, the divergence of A(A;) implies that a large deviation 
principle cannot be formulated for sums of symmetric Levy random variables. This is expected since the 
probability density of such sums is known to have power-law tails that decay slower than an exponential in n 
[_u /]. If we attempt to calculate a rate function in this case, we trivially find / = 0, as in Example III.4 (see 
also [168]). 

In some cases, Cramer's Theorem can be applied where A(A;) is differentiable to obtain information about 
the deviations of a random variables for a restricted range of its values. The basis of this local or pointwise 
application of Cramer's Theorem has to do with Legendre duality. In the case where X{k) is differentiable 
for all /c G M, we have seen already that the Legendre-Fenchel transform 

I{s) = sup{ks - X{k)} (80) 

k 
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FIG. 7: (a) Probability density -pix) of a Levy random which is totally skewed to the left with a = 1.5 and h=\. The 
left tail of p(a;) decays as |a;|^^'^, while the right tail decays faster than an exponential; see [210] for more details, (b) 
Corresponding A(fc) for fc > 0; A(fc) = oo for A; < 0. 



reduces to the Legendre transform 



(81) 



where k{s) is the unique solution of A'(A;) = s. By Legendre duaUty, the Legendre transform can also be 
written as 



I{s{k)) = ks{k)-X{k), 



(82) 



where s{k) = X'{k). Thus we see that if X{k) is differentiable at k, then the rate function / at the point s{k) 
can be expressed through the Legendre transform shown above. By applying this local Legendre transform 
to all the points k where A is differentiable, we are then able to recover part of I{s) even if X{k) is not 
everywhere differentiable. This is illustrated next with a variant of the previous example. 

Example IV.3 (Totally skewed Levy random variables). Not all strictly stable random variables have an 
infinite generating function for k y^ 0. A particular subclass of these random variables, known as totally 
skewed to the left, is such that 



X{k) = In /: 



^kx^ 



hk"' if A; > 
oo otherwise, 



(83) 



where 6 > and a G (1,2) [210, 267]. The probability density associated with this log-generating function 
is shown Fig. 7. The situation that we face here is that X{k) is not defined for all fc G M. This prevents us 
from using Cramer's Theorem, and so from using the Legendre-Fenchel transform of Eq. (80) to obtain 
the full rate function I{s). However, following the discussion above, we can apply Cramer's Theorem 
locally where A(A;) is differentiable to obtain part of the rate function I{s) through the Legendre transform 
of Eq. (82). Doing so leads us to obtain I{s) for s > 0, since A'(A;) > for A: > [ ]. For s < 0, it can be 
proved that the probability density of 5„ has a power-law decaying tail [209], so that I{s) = for s < 0, as 
in the previous example. This part of /(s) cannot be obtained from the Legendre transform of Eq. (82), but 
yields in any case no useful information about the precise decay of the probability density of S'„ for Sn < 0. 

This trick of locally applying the Legendre transform shown in Eq. (82) to the differentiable points 
of A(A;) to obtain specific points of I{s) works for any random variables not just sample means of IID 
random variables. Therefore, although the Gartner-Ellis Theorem does not rigorously apply when A(A;) is 
not everywhere differentiable, it is possible to obtain part of the rate function associated with X{k) simply 
by Legendre-transforming the differentiable points of X{k). In a sense, one can therefore say that the 
Gartner-Ellis Theorem holds locally where X{k) is differentiable. The justification of this statement will 
come in Sec. IV D when we discuss nonconvex rate functions. 
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B. Sanov's Theorem 

Large deviation principles can be formulated for many types of random variable, not just scalar random 
variables taking values in M. One particularly important case of large deviation principles is that applying to 
random vectors taking values in M'^, d > 1. To illustrate this case, let us revisit the problem of determining 
the probability distribution P(L„ = I) associated with the empirical vector L„ introduced in Example II.4. 
Recall that, given a sequence uj = {uji,lu2, • • • , i^n) of n IID random variables taking values in a finite set A, 
the empirical vector Ln{uj) is the vector of empirical frequencies defined by the sample mean 

1 " 

Lnj{uj) = -Y,6u^^,j, iGA. (84) 

" i=i 

This vector has |A| components, and the space of L„, as noted earlier, is the set of probability distributions 
on A. 

To find the large deviations of L„, we consider the vector extension of the Gartner-Ellis Theorem obtained 
by replacing the product kLn in the definition of X{k) by the scalar product k ■ Ln involving the vector 
k G M^. Thus the scaled cumulant generating function that we must now calculate is 

A(A;) = lim -ln/e"^'-^"V fc G M^. (85) 

Since L„ is a sample mean of IID random variables, the expression of \{k) simplifies to 

A(A;)=ln^p,e'=^ (86) 

where pj = P{uJi = j), j G A. The expression above is necessarily analytic in fc if A is finite. In this case, 
we can then use the Gartner-Ellis Theorem to conclude that a large deviation principle holds for L„ with a 
rate function I{1) given by 

/(/) = sup{A; • / - A(A;)} = k{l) ■ I - X{k{l)), (87) 

k 

k{l) being the unique root of V\{k) = I. Calculating the Legendre transform explicitly yields the rate 
function 

I(/) = ^/,ln-^, (88) 

which agrees with the rate function calculated by combinatorial means in Example II.4. 

The complete large deviation principle for L„ is known in large deviation theory as Sanov's Theorem 
[245]; see [86] for a discussion of Boltzmann's anticipation of this result. As already noted, /(/) has a unique 
minimum and zero located at / = p. Moreover, as most of the rate functions encountered so far, /(/) has the 
property that it is locally quadratic around it minimum: 



i,jeA ^ 



i=p ieA 



2er P^ 



Extensions of Sanov's Theorem exist when A is infinite or even continuous. The mathematical tools 
needed to treat these cases are quite involved, but the essence of these extensions is easily explained at a 
heuristic level. For definiteness, consider the case where the IID random variables wi, a;2, . . . , Wn take values 
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in R according to a probability density p{x). For this sequence, the continuous extension of the empirical 
vector Ln is the empirical density 

1 " 
LJx) = - V 6(L0^ -x), X G M, (90) 

n ■^^ 

involving Dirac's delta function 6. This is a normalized density in the sense that 

L„(x) dx = 1 (91) 

for all Lo £ M". Since L„ is now a function (it is a random function to be more precise), the vector k used in 
the discrete version of Sanov's Theorem must be replaced by a function k{x), so that 



k- Ln= / k{x)Ln{x) dx. (92) 

Similarly, the analog of A(A;) found in Eq. (86) is now a functional of k{x) having the form 

A(fc) = In r p{x) e'=(^) dx = In (e'^^^A . (93) 

To apply the Gaitner-Ellis Theorem to this functional, we note that A(A;) is differentiable in the sense of 
functional derivatives: 

a(fc) ^ p(j/)e^fa) 

5k{y) (e^(^)) ■ ^ ^ 

By analogy with the discrete case, L„ must then satisfy a large deviation principle with a rate function /(//) 
equal to the (functional) Legendre transform of A(A;). The result of that transform, as should be expected, is 
the continuous version of the relative entropy: 

/(;,) = r dx ^(x) In 44 • (95) 

To complete this result, it must be added that I{fi) = cxd if ^u has a larger support than p, that is mathematically, 
if p is not continuous relative to p. This makes sense: the realizations of L„ cannot have a support lai^ger 
than that of p. 

C. Markov processes 

Sample means of IID random variables constitute the simplest example of stochastic processes for which 
large deviation principles can be derived. The natural application to consider next concerns the class of 
Markov processes. Large deviation results have been formulated for this class of processes mainly by Donsker 
and Varadhan [65, 66, 67, 68], who established through their work much of the basis of large deviation theory 
as we know it today. Our treatment of these processes will follow the path of the Gartner-Ellis Theorem, and 
will be presented, for simplicity, for finite Markov chains. The case of continuous-time Markov processes 
will be discussed in Sec. VI when dealing with nonequilibrium systems. Some subtleties of infinite-state 
Markov chains will also be discussed in Sec. VI. 

The study of Markov chains is similar to the study of IID sample means, in that we consider a sequence 
LO = {loi,u!2, • • . , uJn) of 71 random variables taking values in some finite set A, and study the sample mean 

n 

Sn = -Tf{u;i) (96) 

n ^-^ 
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involving an arbitrary function / : A ^ R*^, d > 1. The difference with the IID case, apart from the added 
function /, is that we now assume that the Wj's form a Markov chain defined by 

n 

P{lj) = P(u;i,W2,---,Wn) = p(u;i) JJvr(a;i|a;i_i). (97) 

i=2 

In this expression, p{uJi) denotes the probability distribution of the initial state ui, while TT{uJi\uJi^i) is the 
conditional probability of Wj given Wj-i- We consider here the case where tt is a fixed function of ljj and 
cjj_i, in which case the Markov chain is said to to be homogeneous. The sample mean Sn thus defined on 
the Markov chain uj is often referred to as a Markov additive process [32, 53, 2 1 3, 2 14]. 

To derive a large deviation principle for 5„, we proceed as before to calculate A(A;). The generating 
function of this random variable can be written as 



y^ 'Kk{^n\^n-l)---T^k{^2\'^l)Pk{^l), (98) 



Li;i,W2,...,<^n 



iA]l,ljJ2,...,lJJn 



by defining pk{^i) = p{uJi)e'''^^'^''-^ and TTk{uJi\uJi-i) = 7T{uji\uji^i)e^''f^'^^\ We recognize in the second 
equation a sequence of matrix products involving the vector of values Pk{^i) and the transition matrix 
7rfc(Lijj|a;j_i). To be more explicit, let us denote by pk the vector of probabilities /Ofc(wi = i), that is, {pk)i = 
Pk{u!i = i), and let 11^ denote the matrix formed by the elements of 7rk{^i\iOi-i), that is, (11^)^2 = 7Tk{j\i)- 
In terms of pk and 11^, we then write 

nk-Sn\ _ Y^ /'tt"-1 



jeA 



^kPk),, (99) 



The function X{k) is extracted from this expression by determining the asymptotic behavior of the product 
n^^^Pfc using the Perron-Frobenius theory of positive matrices. Depending on the form of 11, one of three 
cases arises: 

Case A: 11 is ergodic (irreducible and aperiodic), and has therefore a unique stationary probability dis- 
tribution p* such that lip* = p*. In this case, n^ has a unique principal or dominant eigenvalue 
C(nfc) from which it follows that (e"'''^") x ((n^)", and thus that X{k) = In ((n^). Given that U 
is assumed to be finite, Ci^k) must be analytic in k. From the Gartner-Ellis Theorem, we therefore 
conclude that Sn satisfies a large deviation principle with rate function 

/(s) =sup{A;-s-lnC(nfc)}. (100) 

k 

Case B: 11 is not irreducible, which means that it has two or more stationary distributions (broken ergodicity). 
In this case, X{k) exists but depends generally on the initial distribution p{lji). Furthermore, \{k) 
may be nondifferentiable, in which case the Gartner-Ellis Theorem does not apply. This arises, for 
example, when two of more eigenvalues of 11^ compete to be the dominant eigenvalue for different 
initial distribution p{loi) and different k. 

Case C: 11 has no stationary distributions (e.g., 11 is periodic). In this case, no large deviation principle 
can generally be found for Sn- In fact, in this case, the Law of Large Numbers does not even hold in 
general. 

The next two examples study Markov chains falling in Case A. The first example is a variation of 
Example II. 1 on random bits, whereas the second generalizes Sanov's Theorem to Markov chains. For 
examples of Markov chains falling in Case B, see [63, 64]. 
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FIG. 8: (a) Transition probabilities between the two states of the symmetric binary Markov chain of Example IV.4. (b) 
Corresponding scaled cumulant generating function A(fc) and (c) rate function /(r) for a = 0.25, 0.5, and 0.75. 



Example IV.4 (Balanced Markov bits [222]). Consider again the bit sequence h = (6i, 62, . . . , 6„) of 
Example II. 1, but now assume that the bits have the Markov dependence shown in Fig. 8(a) with a € (0, 1). 
The symmetric and irreducible transition matrix associated with this Markov chain is 



n 



7r(0|0) 7r(0|l) 
7r(l|0) 7r(l|l) 

The largest eigenvalue of 



1 — a a 
a 1 — a 



n, 



1 



a 



a 



ae 



(1 



a e 



(101) 



(102) 



can be calculated explicitly to obtain A(A;). The result is shown in Fig. 8 for various values of a. Also shown 
in this figure is the corresponding rate function I{r) obtained by calculating the Legendre transform of A(A;). 
The rate function clearly differs from the rate function found for independent bits. In fact, to second order in 
e = 1/2 — a we have 



I{r) ^ Io{r) + 2(1 - 2rf£ + (2 



32r^ + 64r^ 



32r4)e2, 



(103) 



where Io{r) is the rate function of the independent bits obtained here for a = 1/2 or, equivalently, for e = 0; 
see Eq. (3). Note that the zero of /(s) does not change with a because the stationary distribution of the 
Markov chain is uniform for all a S (0, 1), which means that the most probable sequences are the balanced 
sequences such that Rn = 1/2. What changes with a is the propensity of generating repeated strings of 
O's or I's in a given bit sequence. For a < 1/2, a bit is more likely to be followed by the same bit, while 
for a > 1/2, a bit is more likely to be followed by its opposite. The effect of this correlation, as can be 
seen from Fig. 8(c), is that empirical frequencies of I's close to or 1 are exponentially more probable for 
a < 1/2 than for a > 1/2. 

Oono [222] discusses an interesting variant of the example above having absorbing states and a corre- 
sponding linear rate function. General quadratic approximations of rate functions of Markov chains are also 
discussed in that paper. 

Example IV.5 (Sanov's Theorem for Markov chains). The extension of Sanov's Theorem to irreducible 
Markov chains can be derived from the general Legendre -Fenchel transform shown in (100) by choosing 
f{u!i) = Si^^j, j G A, in which case vrfc(j|i) = TT{j\i)e^i . Ellis shows in [ ] (see Theorem III.l) that the 
supremum over all vectors k G M^ involved in that transform can be simplified to the following supremum: 



m 



u\ 



sup > /,• In ,^\ = sup ( In -— 
u>o ^ (nn)j „>o \ Uu 



\li 



(104) 
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which involves only the strictly positive vectors u in R^. This result was first obtained by Donsker and 
Varadhan [ ]; for a proof of it, see Sec. 3.1.2 of [""] or Sec. V.B of [" "]. The minimum and zero of this rate 
function is the stationary distribution p* of 11. 

The expression of the rate function for the empirical vector is obviously more complicated for Markov 
chains because of the correlations introduced between the random variables u>i,lo2, ■ ■ ■ ,uJn- Since these 
random variables "interact" only between pairs, it may be expected that a rate function similar in structure 
to the relative entropy is obtained if we replace the single-site empirical vector by a double-site empirical 
vector or empirical matrix, that is, if we look at the frequencies of occurrences of pair values in a Markov 
chain. Mathematically, this pair empirical matrix should be defined as 



1 " 



n 

i=l 



(105) 



by requiring that ujn+i = ^i because Qn{x, y) then has the nice property that 



^Qn{x,y) = Ln{y), and ^ Q„(x,y) = L„(x), (106) 

x'gA j/eA 

where -L„ is the usual empirical vector of the random sequence uj = (wi, 0^2, • • • , Wn)- In this case, Qn is 
said to be balanced or to have shift-invariant marginals. 

The rate function of Qn can be derived in many different ways. One which is particularly elegant focuses 
on the sequence C = (Cii C2, • • • , Cn) which is built from the contiguous pairs C,i = (wi, Wj+i) appearing in 
the sequence u = {uji ,uj2, ■ ■ ■ , tOn)- The empirical vector of ( is the pair empirical distribution of lo, and 
the probability distribution of ( factorizes in a way that partially mimics the IID case. Combining these 
two observations in Sanov's Theorem, it then follows that Qn satisfies a large deviation principle with rate 
function 

where l{x) is the marginal of q{x, y). The complete derivation of this large deviation result can be found 
in Sec. 3.1.3 of [ ]. Note that the zero of /3(g) is reached when q{x, y)/l{x) = 7r(y|x), in which case 
l{x) = p*{x), where p* is again the unique stationary distribution of 11. 

D. Nonconvex rate functions 

Since Legendre-Fenchel transforms yield functions that are necessarily convex (see Sec. Ill E 6), one 
obvious limitation of the Gartner-Ellis Theorem is that it cannot be used to calculate nonconvex rate functions 
and, in particular, rate functions that have two or more local or global minima. The breakdown of this 
theorem for this class of rate functions is related to the differentiability condition on A(fc). This is illustrated 
and explained next using a combination of examples and results about convex functions. 

Example IV.6 (Multi-atomic distribution [ ]). A nonconvex rate function is easily constructed by con- 
sidering a continuous random variable having a Dirac-like probability density supported on two or more 
points. The rate function associated with p{Yn = y) = ^S{y i 1), for example, is 

iiy) = l^ '^r^' (108) 

^^ [00 otherwise, 

and is obviously nonconvex as it has two minima corresponding to its two non-singular values (a convex 
function always has only one minimum). Therefore, it cannot be expressed as the Legendre-Fenchel transform 
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FIG. 9: Legendre-Fenchel transforms connecting (a) a nonconvex rate function I{s), (b) its associated scaled cumulant 
generating function A(fc), and (c) the convex envelope I**{s) of I{s). The arrows illustrate the relations /* = A, 

A* = /** and (/**)* = A. 



of the scaled cumulant generating function X{k) of y„. To be sure, calculate X{k): 

1 p-nfe I nk 

X{k) = lim -In^ T^ = \k\ 



and its Legendre-Fenchel transform: 



r 



'{y) = sup{% 

k 



Km 



ifye[-l,l] 
cxD Otherwise. 



(109) 



(110) 



The result does indeed differ from /(y); in fact, I{y) / I**{y) for y G (—1,1). 

The Gartner-EUis Theorem is obviously not applicable here because \{k) is not differentiable at A; = 0. 
However, as in the example of the skewed Levy random variables (Example IV.3), we could apply the 
Legendre transform of Eq. (82) locally where A(/c) is differentiable to obtain some part of I{y). In this case, 
we obtain only two points of this function, namely, /(—I) = and /(I) = 0, since A'(A;) = — 1 for fe < 
and A' (A;) = 1 for fc > 0. 

The previous example raises a number of important questions related to the Gartner-EUis Theorem and 
the way rate functions are calculated. The most obvious has to do with the differentiability of \{k): Is there a 
general connection between the differentiability of this function and the convexity of rate functions? Indeed, 
why is \{k) required to be differentiable in the Gartner-EUis Theorem? Moreover, what is the result of the 
Legendre-Fenchel transform of \{k) in general? To answer these questions, we list and discuss next four 
results of convex analysis that characterize the Legendre-Fenchel transform. All of these results can be found 
in [238] (see also [ ] and Chap. VI of [ ]). 

Result 1: The Legendre-Fenchel transform of / yields A whether / is convex or not. 

This result follows essentially because \{k) is always convex. In convex analysis, the Legendre-Fenchel 
transform of / is denoted by /*. Thus /* = A for all A, in accordance with Varadhan's Theorem. 

Result 2: If / is nonconvex, then the Legendre-Fenchel transform of A, denoted by A*, does not yield /; 
rather, it yields the convex envelope of /. 

This result is illustrated in Fig. 9. The convex envelope is usually denoted by I**, since it is given by 
the double Legendre-Fenchel transform of /, and is such that /** < /. With this notation, we then have 
A* = I** 7^ / if / is nonconvex, and / = A* = I** if / is convex. Accordingly, when a rate function I is 
convex, it can be calculated as the Legendre-Fenchel transform of A. 

Result 3: The convex envelope /** of / has the same Legendre-Fenchel transform as /, that is, (/**)* = 
/* = A; see Fig. 9. In general, functions having the same convex envelope have the same Legendre- 
Fenchel transform. 
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(a) 





FIG. 10: (a) Nonconvex rate function / and its convex envelope /* 
function X{k) having a nondifferentiable point at kc- 



(b) Associated scaled cumulant generating 



This property explains why nonconvex rate functions cannot be obtained from A. Put simply, the Legendre- 
Fenchel transform is a many-to-one transformation for the class of nonconvex functions. We also say that the 
Legendre-Fenchel transform is non-self-dual or non-involutive for nonconvex functions. 

Result 4: A is nondifferentiable if / is nonconvex. To be more precise, suppose that I{s) differs from its 
convex envelope I**{s) over some open interval (s;, Sh), as in Fig. 10(a). Then its Legendre-Fenchel 
transform /* = A is nondifferentiable at some value kc corresponding to the slope of I**{s) over the 
interval {si,Sh)', see Fig. 10(b). Moreover, the left- and right-derivatives of A at kc equal s/ and Sh, 
respectively. The same results hold when I{s) is linear (we also say affine) over {si, Sh)- 

The condition of differentiability of A(A;) entering in the Gartner-Ellis Theorem can be understood from 
these results as follows. From the results 2 and 3, we have that a rate function / can be obtained as the 
Legendre-Fenchel transform of A only if / is convex. This leaves us with two possibilities: either / is strictly 
convex, that is, it is convex with no linear parts, or else / is convex but has one or more linear parts. The 
second possibility leads to a nondifferentiable A(A;), as is the case for a nonconvex / according to the results 
3 and 4, so these two cases cannot be distinguished from the point of view of A; see Fig. 9. Hence, the only 
possibility for which the sole knowledge of A enables us to write I = A* is when / is strictly convex. In this 
case, A is differentiable by the result 4, as required by the Gartner-Ellis Theorem. 

This reasoning shows, incidentally, that the differentiability of X{k) is a sufficient but not a necessary 
condition for having / = A*. Simply consider the case where / is convex but has one or more linear parts. 
Then / = A* , since / is convex, but A = /* is nondifferentiable by the result 4. The problem with rate 
functions having linear parts, as pointed out, is that they cannot be distinguished from nonconvex rate 
functions if we only know A. That is, without any a priori knowledge of /, we know for sure that I = X* 
only when X{k) is differentiable. The next example puts these observations into practice. 

Example IV.7 (Mixed Gaussian sum). This example is due to loffe [140]. Consider the sum 



Or} 



1 " 

n ^-^ 



(111) 



i=l 



where the Xj's are IID random variables distributed according to the normal distribution with unit mean 
and unit variance, and where y is a discrete random variable, taken to be independent of the Xj's and such 
that P{Y = — 1) = P(y = 1) = ^. To find the rate function of Sn, we use our knowledge of the Gaussian 
sample mean (see Examples n.2 and IILl) to write 



P{Sn G ds|y = ±1) X e-"^±W dc 



(112) 



(a) 



(b) 




X{k) 
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(c) 



I*%s) 



FIG. 11: (a) Nonconvex rate function I{s) for Example 1V.7. (b) Corresponding \{k). (c) Convex envelope /** (s) of 

I{8). 



where I±{s) = (s =F 1)^/2- As a result, 

P(5„Gds)= ^ P(5„ Gds|y = y)P(y = y) xe-"^-Wds + e-"^+("Msxe-"^(")ds, (113) 



where 



I(s)=min{/_(s),/+(s)} 



/_(s) if s <0 
/+(s) if s > 0. 



(114) 



This rate function is nonconvex, as seen in Fig. 1 1(a). 

We can verify that the Legendre-Fenchel transform of \{k) yields the convex envelope of I{s) rather 
than I{s) itself. Following the previous example, we find here 



\{k) = hz'^ + \kl keR. 



(115) 



Notice that A(A;) is nondifferentiable at A; = 0; see Fig. 1 1(b). Taking the Legendre-Fenchel transform yields 

(116) 



/_(s) ifs < -1 
r*{s) = sup{ks - X{k)} = { if s e [-1, 1] 

/+(s) ifs> 1. 



Figure 1 1(c) shows that /**(s) is the convex envelope of I{s), which differs from /(s) for s G (—1,1). The 
part of /(s) that can be obtained by applying the local Legendre transform of Eq. (82) to the differentiable 
branches of X{k) is the part of /(s) that coincides with its convex envelope. We leave it to the reader in 
the end to show that (/**)* = /* = A. The calculation of these Legendre-Fenchel transforms involves an 
interplay of local and global maximizers which accounts for the nondifferentiable point of A(A;). 

The last example of this section is there to show that boundary points of X{k) can also be thought of as 
nondifferentiable points for the purpose of the Gartner-Ellis Theorem. 

Example IV.8 (Non-steep A). Consider again the sum Sn shown in (1 1 1), but let Y = Z/n, where Z is an 
exponentially-distributed random variable with unit mean, that is, p{Z = z) = e~^, z > 0. The calculation 
of A (A;) for Sn yields 



^2 I 

X{k) = h lim — In ( e' 

2 n^oo n 



kZ 



k'^/2 if fc < 1 
cxD if fc > 1. 



(117) 



Applying the Legendre transform of Eq. (82) to the differentiable branch of this function leads to I{s) = s^/2 
for s < 1, since X'{k) < 1 for A; G (— oo, 1); see Fig. 12(a). As in the previous examples, the Legendre 
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(b) 



(c) 





FIG. 12: (a) A(fc) for Example 1V.8. (b) Rate function I{s) for that example, (c) Nonconvex rate function J{s) having 
the same Legendre-Fenchel transform as I{s). 

transform of X{k) yields here only part of I{s) because the image of A'(fc) does not cover the whole range of 
Sn- In the present example, we say that A(A;) is non-steep because its derivative is upper bounded. 

To obtain the full rate function of Sn, we can follow the previous example by noting that, conditionally 
on Z = z, Sn must be Gaussian with mean z/n and unit variance. Therefore, 



P{Sn 



f'OO re 

/ p{Sn = s\Z = z) p{Z = z) Az ^ / 
Jo Jo 



~n{s-z/n)^/2 ^-z ^^^ 



(118) 



A large deviation principle is extracted from the last integral by performing the integral exactly or by using 
Laplace's approximation. In both cases, we obtain p{Sn = s) x e~"^^''\ where 



I{s) 



s-1/2 ifs > 1 
sV2 ifs<l. 



(119) 



As seen in Fig. 12(b), /(s) is not strictly convex, since it is linear for s > 1; hence the fact that this part 
cannot be obtained from the Gartner-Ellis Theorem. The nondifferentiable point of X{k) associated with this 
part of /(s) is non-trivial: it is the boundary point of X{k) located at A; = 1. That nondifferentiable point 
would also arise if I{s) were nonconvex for s > 1 instead of being linear; see Fig. 12(c). 

There is an extra mathematical subtlety related to the boundary point of X{k), namely, that the Legendre- 
Fenchel transform of /(s) does not yield X{k) at A; = 1. This may seem to contradict Varadhan's Theorem, 
but there is in fact no contradiction here. Simply, there is a technical condition associated with this theorem 
which we have not mentioned (see, e.g.. Theorem 5.1 of [ ] or Theorem 4.3.1 of [ ]), and which happens to 
be violated in the present example. Mathematically, the problem arises because Legendre-Fenchel transforms 
yield functions that are lower semi-continuous in addition to being convex [238, 272]. Here X{k) is convex 
but not lower semi-continuous, since its domain is open; hence the fact that A 7^ I at /c = 1. In practice, 
boundary points of X{k) appear to be the only points for which we may have A / /*, and thus for which 
Varadhan's Theorem must be applied with care. 

Other examples of nonconvex rate functions related to non-irreducible Markov chains having more that 
one stationary distributions are discussed by Dinwoodie [63, 64]. These examples relate to the Case B of 
Markov chains mentioned before. In the end, it should be kept in mind that nonconvex rate functions pose no 
limitations for large deviation theory; they pose only a limitation for the Gartner-Ellis Theorem because of 
the way that theorem relies on Legendre-Fenchel transforms. We will see in the next section other methods 
that can be used to calculate rate functions, be they convex or not. 

E. Self-processes 



There are many random variables, apart from sample means, that can be studied from the point of view of 
large deviation theory. One which is often studied in information theory and in nonequilibrium statistical 
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mechanics is 

An{uj) = --In Pniiv), (120) 

n 

where Pn{i^) denotes, as usual, the probability distribution of the sequence to = {u}i,lo2, • • • , Wn)- We call 
An a self-process, since it is a transformed version of Pn{io). Therefore, studying the large deviations of An 
with respect to P„ is, in a way, the same as studying the large deviations of P„ with respect to itself. 

The rate function of An can be calculated using the Gartner-Ellis Theorem once the nature of to is 
specified. The random variables loi,(jJ2, ■ ■ ■ ,^n can form, for example, a Markov chain or can be IID, in 
which case An reduces to a simple IID sample mean. Note in this case the form of X{k): 

X{k) = lim -In/e-'^^'^^'A = lim - In V P^H^-^^ = InV P(wi = Jy-^ (121) 

Other types of sequences of random variables or stochastic processes can be dealt with by calculating X{k) 
from its definition; see in particular [173, 174] for the treatment of continuous-time Markov processes. 

An important point to note here is that, if the rate function /(a) of An has a unique global minimum and 
zero, as is the case when /(a) is convex, then 

lim {An) = a* (122) 



and 



lim An = a* (123) 

71— >00 



with probability 1. The first limit involving (An) implies, on the one hand, that the mean Boltzmann-Gibbs- 
Shannon entropy 

Hn = --y] Pn{uj) In Pn{co) (124) 

LjeA" 

converges to the constant a*, which is called the entropy rate [49] or Kolmogorov -Sinai entropy [12, 118]. 
On the other hand, the limit (123) involving An alone implies 

--lnP„(a;i,a;2,- •• ,Wn) ^ a* (125) 

n 

with probability 1 as n — > oo. The latter limit is known as the Asymptotic Equipartition Theorem or the 
Shannon-McMillan-Breiman Theorem [ ] . What this result says concretely is that most of the probability 
P„(u;) is concentrated on sequences in A" such that Pn{i^) ^ e""*^ . The set 7^ containing these sequences 
is commonly called the typical set of A" [49]. Thus P{Tn) — > 1 and Pn{i^) ^ e"*^"* for all a; G 7^ in 
the limit n — > oo, which implies that 7^ must contain about e"*^' typical sequences. These results are 
fundamental in information theory; for a more detailed discussion of this point, see Chap. X of [ ], Sec. 3.6 
of [53] or Chap. 12 of [ , .]. For an application of the self-process in the context of nonequilibrium systems, 
see Example VI. 10. 

Example IV.9 (Entropy rate of a Markov source). For an ergodic Markov chain with transition matrix 
7r(j|i), the entropy rate is 

a* = A'(0) = -J2 7T{j\i)p*{i) In 7r{j\i), (126) 

i,jeA 

p* being as usual the unique stationary distribution of the Markov chain. 
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F. Level 1, 2 and 3 of large deviations 

It is customary since the work of Donsker and Varadhan to define three levels of large deviation results 
referred to as the Level- 1,2 and 3 of large deviations [S4]. Level-1 is the level of sample means, whereas Leve/- 
2 is the level of Sanov's Theorem, that is, the level of the large deviations of the empirical vector L„. The 
reason for ordering the large deviations of the empirical vector above those of sample means is that the latter 
can be derived from the former using the contraction principle. To see this, let uj = {iOi,u}2, • • • , u!n) G A" 
be a sequence of random variables, which are not necessarily independent, and let 

1 " 

Sn = -y2f{uJi). (127) 

i=l 

In terms of the empirical vector L„ of lo, 5„ can always be written as 



Sn= / f{x)Ln{x)dx = f-Ln (128) 

Thus, given the rate function hifJ-) of L„, we can use the contraction formula (74) with /i(^) = / • // to 
express the rate function /i(s) of 5„ as 

h{s)= inf hifi). (129) 

fj.:h(iJ,)=s 

The contraction function h{fi) is often written as fi{f) or (/) to emphasize that it is an average of / 
taken with respect to the random density fi. The empirical vectors solving the constrained minimization 
problem of Eq. (129) have an interesting probabilistic interpretation: they are, in the limit n —>■ oo, the 
most probable vectors L„ such that h{Ln) = s. Consequently, these vectors must maximize the conditional 
probability 

P{L^ e d^.\h{K) E d.) = p(^(^^) ^ ^^) , (130) 

which implies that they must also globally minimize the rate function 

[ oo otherwise. 

Consequently, Ii{s) = inf^/|(;u). 

Example IV.IO (Sample means via Sanov's Theorem). The constrained minimization arising from the 
contraction of Level-2 to Level-1 can be solved explicitly for IID sample means. For this case, hifJ-) is the 
relative entropy and the contraction formula (129) is referred to as the minimum relative entropy principle 
[222]. To solve the constrained minimization, we use Lagrange's multipliers method and search for the 
unconstrained critical points of 

Fc,(/i) = ah{n) - hifi), a G M. (132) 

Since hifJ') is strictly convex and h{fi) = (f)^ is a linear and differentiable functional of fi, Fa{^) has a 
unique maximum ^q, for all a G M satisfying 5Fa{na) = 0. Given the expression of the relative entropy, the 
expression of /ia is found to be 

^-(^) = ^^wf?^ ' ^(«) = / P(^)e"^^"^ dx = (e"^W) (133) 
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with the value of a imphcitly determined by the constraint h{fia) = {f)fia — ^ o^, equivalently, 
W'{a)/W{a) = s. The expression for fia makes sense, obviously, provided that W{a) < cxd. If this 
is the case, then /i(s) = hifJ-a)- Equivalently, 

h{s) = as-lnW{a), (134) 

since 

FaifJ-a) = ah{iJ,a) - hifJ-a) = OS - hifJ-a) = InH^(a). (135) 

We recognize in Eq. (134) the result of Cramer's Theorem. 

Example IV.ll (Symmetric Levy random variable revisited). The contraction of Level-2 to Level-1 does 
not work for sample means of symmetric Levy random variables because W{a) = oo for all a 7^ 0. This 
case is discussed by Lanford [ ], who proves the result reached in Example IV.2, namely, I{s) = 0. 

The Level-3 of large deviations, from which Level-2 is obtained by contraction, is the level of the pair 
empirical distribution Qn{x,y), which is commonly completed by including all the ?TT,-tuple empirical 
distributions defined on lij = {loi,uj2, ■ ■ ■ ,ujn), 2 < m < n. In defining m-tuple empirical distributions, 
we require, as we did for the pair empirical distribution, that uJn+i = wi, iOn+2 = ^2, and so forth until 
iOn+m = Wm, SO as to guarantee that all the {m — l)-tuple distributions obtained by contraction of an 
m-tuple distribution are the same. The n-tuple distribution of an n-tuple sequence is the ultimate empirical 
distribution that can be defined. In the limit n — > 00, such a distribution becomes an infinite joint empirical 
distribution called the empirical process [' ]. The construction of this abstract process is explained in 
Sec. 6.5.3 of [ ] or Chap. IX of [ ,]. We will limit ourselves here to noting that, for sequences of IID 
random variables, the empirical process possesses a convex rate function, and that the zero of this rate 
function is the infinite product of p, the common probability distribution of the IID random variables. 

We close this section by noting an alternative characterization of the Level-2 rate function of Markov 
chains, derived by contracting the large deviations of the pair empirical matrix. 

Example IV.12 (Sanov's Theorem for Markov chains revisited). Let L„ and Qn denote, respectively, the 
empirical vector and empirical matrix of an irreducible Markov chain. The contraction h{Qn) = Ln that 
takes Qn to L„ is the usual "tracing-out" operation expressed in Eq. (106). Given the rate function l3{q) of 
Qn found in Eq. (107), we then have 

h{^i)= inf h{q) (136) 

for the rate function of L„. 

V. LARGE DEVIATIONS IN EQUILIBRIUM STATISTICAL MECHANICS 

The previous sections introduced all the large deviation results that will now be applied to study the 
properties of physical systems composed of many particles. We start in this section with the equilibrium 
properties of many-particle systems described at a probabilistic level by statistical-mechanical ensembles, 
such as the microcanonical or canonical ensembles. The use of large deviation techniques for studying 
these systems has its roots in the work of Ruelle [ ], Lanford [ 1 68], and especially Ellis [84, 85, 86]. Of 
these sources, Ellis [ ] is the first that explicitly referred to the mathematical theory of large deviations, as 
developed by Donsker and Varadhan [65, 66, 67, 68], among others. The many links that exist between large 
deviations and equilibrium statistical mechanics have also been discussed by Lewis, Pfister, and Sullivan 
[178, 179, 180, 181, 183, 184], as well as by Oono [ ]. A basic overview of some of these links can be 
found in [3]. 
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The material presented in this section borrows from all these sources. By defining statistical-mechanical 
ensembles in a way that is explicitly focused on large deviation theory, we aim to show here that the study 
of equilibrium states and their fluctuations in a given ensemble can be reduced to the study of properly- 
defined rate functions. In the process, many connections between equilibrium statistical mechanics and large 
deviation theory will be established and discussed. We will see, in particular, that entropy functions are 
special rate functions, and that variational principles, such as the maximum entropy principle or the minimum 
free energy principle, follow from the contraction principle. The last observation is especially useful because 
it provides us with a clear explanation of why variational principles arise in equilibrium statistical mechanics. 
It also provides us with a systematic method or scheme for deriving such variational principles in general. 

A. Basic principles 

The following list of common definitions and postulates, inspired from [84, 168, 242], establishes the 
basis of equilibrium statistical mechanics on which we will work: 

• We consider a collection of n particles (atoms, spins, molecules, etc.) that interact with one another 
through some forces or potentials.^ 

• The collective or: joint state of the n particles is denoted by a sequence u = (i^i, W2, . . . , Wn) of n 
variables, with uJi denoting the state of the ith particle. 

• A sequence uj is called a microstate, as it gives a complete description of the n-particle system at the 
microscopic level. The set or space A„ of all microstates is the n-fold product A" of the one-particle 
state space A. 

• The physical interactions or dependencies between the n particles are determined by a Hamiltonian 
or energy function Hn{uj). Given Hn{uj), we define the mean energy or energy per particle by 

hn{uj) = Hn{uj)/n. 

• The microstate uj of the n-particle system is modeled abstractly as a random variable, which is 
distributed according to a reference or prior probability measure P{dio) on A„. The form of P(dw) 
is determined by physical considerations. For most models, Liouville's Theorem dictates that P{du}) 
be the uniform measure P{duj) = dw/|A„|, where |A„| = |A|" is the volume of A„. Since |A„| is a 
constant, one can work equivalently with the unnormalized (Lebesgue) measure P(dti;) = dto. 

• The probabilistic description of the n-particle system is completed by specifying the external con- 
ditions or constraints under which that system is prepared or studied. The specification of these 
conditions is tantamount to selecting a given statistical-mechanical ensemble, which corresponds 
mathematically to a probability distribution on A„ involving the constraints and the prior distribution 

P{duj). 

• The interactions between the particles give rise to a macroscopic or thermodynamic behavior of the 
whole system that can be described by having recourse to a few macroscopic or "coarse-grained" 
variables called macrostates. Mathematically, a macrostate is just a function Mn{i^) of the microstates. 

• The thermodynamic behavior of the whole system is characterized by one or more equilibrium states, 
defined as the most probable values of a set of macrostates in a chosen ensemble. 
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In keeping with tlie notations of tlie previous sections, we use n to denote tlie number of particles rather that the more common TV 
used in physics. 
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• When calculating equilibrium states, the limit n — > oo is assumed to obtain states that are representa- 
tive of macroscopic systems. This limit is called the thermodynamic limit, and entails in many cases 
the continuum limit. 

The mathematical basis for the notion of thermodynamic behavior is the Law of Large Numbers [168]. 
The idea, in a nutshell, is that the outcomes of a macrostate, say Mn{uj), involving n particles should 
concentrate in probability around certain stable or equilibrium values (macroscopic determinism) despite 
the fact that the particles' state is modeled by a random variable a; (microscopic chaos). Large deviation 
theory enters this picture by noting that, in many cases, the outcomes of M„ are ruled by a large deviation 
principle, and that, in these cases, the concentration of Af„ around equilibrium values is "exponentially 
effective" in the limit n — > oo, as the probability of observing a departure from these equilibrium values is 
exponentially small with the number n of particles. Consequently, all that is needed to describe the state 
of a large many-particle system at the macroscopic level is to know the equilibrium values of M„ which 
correspond to the global minima of the rate function governing the fluctuations of M„. 

These considerations summarize the application of large deviation techniques in equilibrium statistical 
mechanics. What remains to be done at this point is to show how the probabilities of microstates and 
macrostates are to be constructed depending on the nature of the many -particle system studied, and to show 
how rate functions are extracted from these probabilities. For simplicity, we will review here only two types 
of many-particle systems, namely, closed systems at constant energy, and open systems exchanging energy 
with a heat bath at constant temperature. The first type of system is modeled, as is well known, by the 
microcanonical ensemble, whereas the second type is modeled by the canonical ensemble. The treatment of 
other ensembles follows the treatment of these two ensembles. 



B. Large deviations of the mean energy 

Before exploring the large deviations of general macrostates, it is useful to study the large deviations of 
the mean energy hn{io) with respect to the prior distribution P{dio) defined on A„. The rate function turns 
out in this case to be the microcanonical entropy function up to an additive constant, whereas the scaled 
cumulant generating function of /i„ turns out to be the canonical free energy function, again up to a constant. 
These associations and their consequences for thermodynamics are explained next. 

1. Entropy as a rate function 

Using the notation developed in the previous sections, we write the probability distribution of /i„ with 
respect to the prior P{Auj) on A„ as 

P{hn G du) = / Pidu), (137) 

where du = [u,u + Au] is an infinitesimal interval of mean energy values. For the uniform prior measure 
P{dLo) = da;/|A|", P{hn G du) is proportional to the volume 



n{hn G dn) = / dcj (138) 

of microstates uj such that /i„(c<j) G du. Therefore, if P{hn G du) scales exponentially with n, then so must 
^{hn G du). Defining the rate function I{u) of P{hn G du) by the usual limit 

I{u) = lim \nP{hn G du), (139) 

n— >oo ji 
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we must then have 

I{u) = In \A\-s{u), (140) 

where 

s(u) = lim -lnJ7(/i„ G du) (141) 

n^oo n 

is the microcanonical entropy or entropy density. Equation (140) proves our first claim, namely, that the rate 
function I{u), if it exists, is the negative of the entropy s{u) up to the additive constant In | A|. 
In the following, we shall absorb the constant In |A| by re-defining the entropy using the limit 

s{u) = lim -lnP(/i„ € dn) (142) 

n~*oo n 

rather than the limit displayed in Eq. (141). This re-definition simply amounts to replacing the Lebesgue 
measure du in the integral of i7(/i„ G u) by the uniform prior measure P{duj), in which case /(u) = —s{u). 
This minor re-definition of the entropy complies with the definition used in works on large deviations and 
statistical mechanics (see, e.g., [84, 85, 181, 222, 229]). It brings, for one thing, the notion of entropy closer 
to large deviation theory, and allows one to use prior measures that are not uniform. Note that throughout 
this review, we also use ks = I. 

2. Free energy as a scaled cumulant generating function 

The proportionality of P{hn S dn) and ^{hn £ dn) noted above implies that 

A(A:) = lim -ln/e"''^"\ (143) 

satisfies 

X{k) = -^m^_,-ln\A\. (144) 

where 

ip{/3)= lim --InZnifS), (145) 

n— >oo n 

and 

Zn{(3) = [ e-"^''"('^) duj= f Q-^"-^^) duo. (146) 

The latter function is the well-known n-particle partition fiinction associated with ff„; accordingly, (p{(3) 
is the canonical free energy function. With these associations, we see, as announced, that X{k) is the free 
energy function of the canonical ensemble up to a constant and a change of variable {[3 = —k). As we did 
for the entropy, we shall absorb the constant In | A| in v?(/3) by re-defining this function as 

^{(3)= lim --In t e-"^^"(") P(dL^) = lim -- In /e-'^^^^^^A (147) 

n^cxD n J f^ n^oo n \ I 

using P{diS) instead of dio as the measure entering in the integral of the partition function. We this new 
definition, we then have A(A;) = — ¥'(/3)L=_fc- This form of free energy function will be used from now on, 
since it also complies with the form used in works on large deviations and statistical mechanics. 

It should be noted for correctness that what is commonly referred to as the free energy in thermodynamics 
is not the function v5(/3) but the function /(/3) = c^(/?)//3. Here we use v'C/^) as the free energy because 
this function has the convenient property of always being concave in /3. The function /(/3), by contrast, is 
concave or convex (negative concave) depending on the sign of fi. In textbooks of statistical mechanics, </9(/5) 
is sometimes called the Massieu potential [..]. 
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3. Legendre transforms in thermodynamics 

The relationships that we have estabhshed between I{u) and s{u), on the one hand, and \{k) and ip{l3), 
on the other, are important because they imply that the Gartner-Ellis Theorem and Varadhan's Theorem 
can be applied to express s{u) as the Legendre-Fenchel transform of ¥?(/?), and vice versa. By transposing 
Varadhan's Theorem at the level of s{u) and (/?(/?), we indeed obtain 

ip{l3)=mi{[5u-s{u)], (148) 

u 

whereas for the the Gartner-Ellis Theorem, we obtain 

s{u) = ini{(iu - (^(/?)}, (149) 

provided that (/?(/3) exists and is differentiable. In both expressions, "inf" stands as before for the "infimum 
of". The reason why the Legendre-Fenchel transform is now expressed with an "inf" instead of a "sup" is, 
of course, because the entropy is defined as the negative of a rate function; see Eq. (140). 

The two Legendre-Fenchel transforms shown above are fundamental in statistical mechanics. The first 
one shown in Eq. (148) provides a precise formulation of the basic thermodynamic principle that states 
that the free energy is the Legendre transform of the entropy. Varadhan's Theorem refines this result by 
establishing that (/7(/3) is, in general, the Legendre-Fenchel transform of s{u), not simply the Legendre 
transform, and that this Legendre-Fenchel transform is valid for essentially any s{u). Legendre-Fenchel 
transforms rather than Legendre transforms must be used in particular when s{u) is not concave. 

The second Legendre-Fenchel transform shown in Eq. (149) is the converse of the first, expressing 
the entropy as the Legendre-Fenchel transform of the free energy. This result is also well known in 
thermodynamics, but in a form that usually also involves the Legendre transform rather than the Legendre- 
Fenchel transform, and without reference to any conditions about the validity of that transform. These 
conditions are the conditions of the Gartner-Ellis Theorem; they are important, and will be studied in detail 
later when discussing nonconcave entropies. 

For convenience, we will often refer thereafter to the two Legendre-Fenchel transforms shown above 
using the "star" notation introduced in Sec. IV D. With this notation, Eq. (148) is expressed as 93 = s*, while 
Eq. (149) is expressed as s = (/?*. 

C. Microcanonical ensemble 

We now come to the problem that we set ourselves to solve in this section: we consider an n-particle 
system represented by a Hamiltonian function Hn{Lo), and attempt to derive a large deviation principle for 
a macrostate M„(a;) of that system. We consider first the case of a closed system constrained to have a 
fixed energy Hn{oj) = U. Other constraints can also be included (see, e.g., [88]). The statistical-mechanical 
ensemble that models the stationary properties of such a system is, as is well known, the microcanonical 
ensemble, which we define mathematically next. 

L Definition of the ensemble 

The microcanonical ensemble is based on the assumption that all the microstates cj G A„ such that 
Hn{co) = U or, equivalently, such that hn{uj) = U/n = u are equally probable (equiprobability postulate). 
Therefore, what we call the microcanonical ensemble at the level of microstates is the conditional probability 
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measure 



P"(dw) = P{duj\hn £du) = < 



if hn{uj) G du 



P{K G du) "' ' (150) 

otherwise, 



which assigns a non-zero and constant probability only to those microstates having a mean energy lying 
in the interval du. The probability P(hn G du) was introduced earlier, and is there to make P"(da;) a 
normalized measure: 

An ^\"'n G QU J{c^eA„:?i„(a;)6d«} 

The extension of the microcanonical measure P''^{duj) to macrostates follows the standard rules of 
probability theory. Given a macrostate M„(tj), we define P^{Mn G dm) to be the conditional or constrained 
probability measure given by 

P^{Mn G dm) = P(M„ G dm\hn G du) = PiK ^du^M edm) ^ ^^^^^ 



P{hn G du) 



where 



P{hn G d-u, M„ G dm) = / P(da;) (153) 

^{w£A„:/i„(cij)6dM,Af„(Li;)Gdm} 

is the joint probability of /i„ and M„. It is this probability measure that we have to use to find the most 
probable values of M„ given that the system represented by the Hamiltonian Hn has a fixed energy Hn = U 
or, equivalently, a fixed mean energy /i„ = U/n = u. The latter expression of the energy constraint involving 
hn is generally preferred over the former involving Hn, since we are interested in finding the most probable 
values of Mn in the large-n or thermodynamic limit. Thermodynamic limits involving a different rescaling 
of the energy are also conceivable, depending on the form of the Hamiltonian. 

2. Microcanonical large deviations 

The theory of large deviations enters in the description of the microcanonical ensemble as a basic tool 
for finding the the values of M„ that maximize the microcanonical probability measure P"(M„ G dm). 
From our knowledge of sample means, we should expect at this point to be able to prove a large deviation 
principle for P^{Mn G dm), and to find the most probable values of M„ by locating the global minima 
of the corresponding rate function. As shown next, this is possible if a large deviation principle holds for 
the unconstrained measure P{Mn G dm), and if there exists a contraction of M„ to /i„. In this case, the 
equilibrium values of M„ that globally minimize the rate function of the constrained measure P^{Mn G dm) 
can be calculated as the global minima of the rate function of the unconstrained measure P{Mn G dm) 
subject to the constraint hn{uj) = u [85, 86]. 

To prove this result, consider a macrostate M„(a'), and suppose that a large deviation principle holds for 
this macrostate with respect to the unconstrained prior measure P{dLo), that is, 

P{Mn G dm) = / P(dcj) X e"''^'") dm. (154) 

J {iueA„:M„{Lu)edm} 

The rate function of this large deviation principle is written without the usual minus sign to conform with the 
notation used in physics. The negative "rate function" S(m,) is called the macrostate entropy of M„, since 
it effectively corresponds to the entropy of M„ defined with the volume measure r2(M„ G dm) up to the 
constant In |A|. 
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Suppose now that the mean energy or energy per particle hn{uj) can be rewritten as a function of the 
macrostate Af„(u;). That is to say, suppose that there exists a bounded, continuous function /i(m) of M„, 
called the energy representation function, such that hn{io) = h{Mn{uj)) for all lij G A„ or, more generally, 
such that 

\K{u:)-h{Mn{u:))\^^ (155) 

uniformly over all w G A„ as n ^ oo. Given that this function exists, it is readily seen that the most 
probable values m of M„(a;) with respect to P^{Mn G dm) are those that maximize the macrostate entropy 
s{m) subject to the constraint h{m) = u. To be sure, construct the explicit large deviation principle for 
P^{Mn G dm). Assuming that P{Mn G dm) satisfies the large deviation principle shown in (154), it 
follows by contraction that P{hn G du) also satisfies a large deviation principle which we write, as before, 
as 

P{K G du) X e""(") du. (156) 

Combining these lai^ge deviations in the expression of P^{Mn G dm,) shown in Eq. (152), we then obtain 

P"(M„ G dm) X e-"^"(™) dm, (157) 

where 

j«(j„) ^ / ^(^) - ^{m) if h{m) = u 
\ oo otherwise. 

The rate function I^{m) is similar to the rate function /|(/u) discussed in connection with the contraction of 
the level-2 large deviations to the level-1 large deviations; see Eq. (131). The main point to observe here is 
that the global minimizers of I'^{m), which correspond to the equilibrium values of M„ in the microcanonical 
ensemble with /i„ = u, are the global maximizers of the macrostate entropy s{m) subject to the constraint 
h{m) = u. Denoting by <S" the set of all such equilibrium values or equilibrium states, we then write 

£^ = {m : I'^{m) = 0} = {m : m globally maximizes s(m) with A(m) = u}. (159) 

The class of macrostates for which <S" can be calculated using the formula above depends on the model 
studied and, more precisely, on the form of its Hamiltonian. This point will be discussed in more detail later. 
It useful to know that <S" can be calculated, at least in theory, without the macrostate entropy s{'m) and 
the energy representation function h{m). If we can prove, for instance, that P{hn G du, Mn{uj) G dm) 
satisfies a joint large deviation principle of the form 

P{hn G du, Mnioj) G dm) x e"^'("'™) du dm, (160) 

then we obtain 

P^'iMn G dm) X e-"'^"^"^) dm, (161) 

where J^{m) = s{u) — s{u, m). In this case, 

<S" = {m : J'^{m) = 0} = {m : m globally maximizes s{u, m)}. (162) 

One may also attempt to obtain I^{m) directly using the Gartner-Ellis Theorem. This method, however, is 
of limited use, since the calculation of the scaled cumulant generating function of M„ in the microcanonical 
ensemble involves a constrained integral on A„ which can be evaluated explicitly only for certain combina- 
tions of macrostates and Hamiltonians (e.g., non-interacting particles). The Gartner-Ellis Theorem is also 
limited in that it cannot be used, as we have seen, to calculate nonconvex rate functions, which implies that it 
cannot be used to calculate nonconcave entropy functions. In this case, the representation of £^ based on 
s{m) and h{m) or s{u, m) alone should be used. The former representation based on s{m) and h{m) is 
generally more practical. 
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3. Einstein 's fluctuation theory and the maximum entropy principle 

The microcanonical large deviation principles displayed in (157) and (161) provide a precise formulation 
of Einstein's theory of microcanonical fluctuations [, , ]. They embody the main result of that theory, which 
is that probabilities in the microcanonical ensemble can be expressed in terms of entropies. But they also 
refine that result, in that 

• They provide a precise expression of the exponential scaling of P"(M„ S dm) with n, which need 
not be satisfied by all macrostates. That exponential scaling is somewhat hidden in Einstein's theory 
in the implicit assumption that the entropy is an extensive quantity.^ 

• They lead us to identify the equilibrium values of M„ not just as those values m maximizing 
P^{Mn G dm), but, more precisely, as the zeros of I'^{m) or J'^{m), thereby bringing the study of 
equilibrium states in direct contact with the Law of Large Numbers.^ 

• They suggest a procedure — a scheme — for deriving general maximum entropy principles that can be 
used to find the equilibrium values of M„, and to calculate s{u) in terms of a maximization involving 
a macrostate entropy. 

The last point simply follows by examining the two representations of the set S'^ of microcanonical 
equilibrium states, defined in Eqs. (159) and (162). The representation of Eq. (159), which involves the rate 
function /"(m), implies on the one hand that 

s{u) = sup s{m). (163) 

m:h{rn)=u 

On the other hand, the representation of Eq. (162), which involves J'^{m) instead of /"(?n,), implies that 

s{u) = sup s{u,7n). (164) 

m 

These variational formulae can also be derived from the contraction principle. In the first formula, the 
contraction is the energy representation function, whereas in the second, the contraction is the map {u,m) — > 
u. Each formula provides, in the end, a general maximum entropy principle that can be used to calculate 
the microcanonical entropy s{u) from the knowledge of a macrostate entropy. The well-known maximum 
entropy principle of Jaynes [ ' ' ' , ' ' ] is a particular application of these formulae, obtained by considering 
the Level-2 large deviations of systems of independent particles. This is explained in the next example. 

Example V.l (Jaynes's Maximum Entropy Principle). Consider a system of n particles with individual 
energies ei,e2, ■ ■ ■ , £n, ^i £ A. Assuming that the particles do not interact with each other, we write the 
mean energy /i„ of the n particles as 

1 " 
hn = -Y^ei. (165) 

1=1 

An obvious choice of macrostate for this model, apart from the mean energy itself, is the empirical vector or 
one-particle energy distribution 

1 " 
Ln{e) = -y^6{e,-e) (166) 



^ Of course, one can always put a probability P in the form P = e simply by defining 5* = In P. The non-trivial result stated in 
Einstein's theory, and more precisely in large deviation theory, is that S = In P is extensive with the number of particles, which 
means that P decays exponentially fast with the number of particles. This statement is the essence of the large deviation principle. 

' This shows, incidentally, that thermodynamics and statistical mechanics are not really concerned about average values so much as 
about most probable values. Equilibrium states are, first and foremost, most probable states. 
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which counts the relative number of particles having an energy e. The energy representation for this choice 
of macrostate is 

h{Ln) = I eLn{e) de. (167) 

From Sanov's Theorem, the large deviations of L„ are ruled by the relative entropy Ip{lj)- For the uniform 
prior p = |A|~^, /p(/i) is related to the Boltzmann-Gibbs-Shannon entropy 



~s{n) = - / de;u(e)ln/i(e) (168) 

Jk 

through /p(^) = —s{ijl) + In |A|. Therefore, 

s{u) = sup s{p) - In |A| (169) 

l:h[ijL)=u 

by the general maximum entropy principle derived in (163). For independent particles, the microcanonical 
entropy s{u) is thus obtained by maximizing the Boltzmann-Gibbs-Shannon entropy s{ii) subject to the 
energy constraint /i(/x) = u. It is this version of the maximum entropy principle that we refer to as Jaynes's 
maximum entropy principle [l-t4, 145]. 

A variational problem similar to the one displayed above was solved in Example IV. 10 when treating the 
contraction of Level-2 to Level- 1 . Its explicit solution, re-written in a more thermodynamic form, is 

/"/3(e) = |(^, Z{P) = l^e-^'de (170) 

with P implicitly determined by hdu-fs) = u or, equivalently, by Z'{/3)/Z{/3) = u. Similarly as in Exam- 
ple IV. 10, we therefore obtain 

s(n) = 5(/i;3)- In |A|=/3n -(/.(/?), (171) 

which is nothing but Cramer's Theorem written in terms of s{u) and y?(/3).^ Since the linear form of h{Ln) 
is directly related to the additive form of /i„, the explicit expression of up does not carry over to the case 
where there is some interaction between the particles. Thus, strictly speaking, Jaynes's maximum entropy 
principle is only applicable to non-interacting particles.^ 

4. Treatment of particular models 

The microcanonical equilibrium properties of systems of non-interacting particles can always be treated, 
as in the previous example, at the Level-2 of large deviations using Sanov's Theorem, or directly at the 
Level-1 using Cramer's Theorem (see, e.g., [ ! 75]). These two levels of large deviations can also be used in 
general to study the equilibrium properties of mean-field models of particles involving an all-to-all coupling 



^ Cramer's Theorem appears here because the mean energy /i„ of non-interacting particles is a sample mean of IID random variables 
under the uniform prior measure P{Au)). 

' The form of the entropy function also depends on the observable considered. To be more precise, one should therefore say that 
Jaynes's maximum entropy principle applies only to the one-particle distribution of non-interacting particle systems. Other 
maximum principles that are applicable to other observables and other systems can be derived, following this section, by obtaining 
an explicit large deviation expression for the probability of a given observable, defined in the context of a given system and 
ensemble. In the end, it is probability that defines the form of a maximum entropy principle, not the choice of an arbitrary entropy 
function or some ad hoc information-based argument. 
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between particles. Examples of such models, for which the general maximum entropy principles mentioned 
before have been applied successfully, include the mean-field versions of the Curie-Weiss model [82, 84, 85] 
and its parent model, the Potts model [ 8, 85, 92, 225], the Blume-Emery-Griffiths model [ 1, 90, 91], the 
mean-field Hamiltonian model [ ], as well as mean-field versions of the spherical model [38, 149], and 
the 0^ model [36, 128, 129]. In all of these models, the energy representation function is either a nonlinear 
function of the empirical vector (Level-2) or a function of properly-chosen Level- 1 macrostates, commonly 
referred to as mean fields or order parameters . This is illustrated in the next two examples. 

Example V.2 (Mean-field Potts model). The mean-field Potts model with q states is defined by the Hamil- 
tonian 

^nH = -^5]<5..,..,, (172) 

where uoi S A = {1,2, ... ,q]. The factor n in front of the sum is there to make the energy an extensive 
variable or, equivalently, to make the mean energy an intensive variable. In terms of the empirical vector 

1 " 

Lni'^) = (-^n,lM,-L„,2(w), • • • ■,Ln,q{uj)), Lnj{uj) = " ^ 5jj (173) 

we obviously have hn{oj) = h{Ln{uj)), where 

1 1 " 

/i(/i) = --/i-/i = --^/x2. (174) 

i=i 

The reader is referred to [48] for the complete calculation of s{u) based on this energy representation 
function, and for the calculation of the equilibrium values of L„ in the microcanonical ensemble. Note that 
the macrostate entropy that needs to be maximized here is the Boltzmann-Gibbs-Shannon entropy, or relative 
entropy, as in the case of non-interacting particles; however, now the energy representation function is a 
nonlinear function of the empirical vector. 

Example V.3 (Mean-field (f)"^ model [36, 128, 129]). The mean-field (p^ model is defined by the Hamiltonian 

where pi,qi G M. We can re- write the mean energy of this model using the following energy representation 
function: 

2 
~ TTl 

h{k,v,m) = k + v — , (176) 

where 

i=l i=l ^ ^ i=\ 

are, respectively, the mean kinetic energy, the mean potential energy, and the mean magnetization of the 
model. The entropy functions of these macrostates can be derived using the Gartner- Ellis Theorem, since 
they are all strictly convex. The entropy sijn) of m, for example, is the magnetization entropy found in 
Example II.5, which is also the negative of the rate function calculated for the binary sample mean of 
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Example IV.l. The calculation of the two other macrostate entropies s{k) and s{v) is reported in [~^6]. In the 
end, we obtain s{u) by solving 

s{u) = sup s{k) + s{v) + s{m). (178) 

{k,v,m):h{k,v,m)=u 

The details of this calculation can be found in [36]. 

When going beyond non-interacting and mean-field systems, two different classes of systems must be 
distinguished: those involving long-range interactions, such as systems of gravitating particles, and those 
involving short-range interactions, such as the nearest-neighbor Ising model. From the point of view of 
the formalism developed here, long-range systems (see [52] for a definition of long-range interactions) are 
similar to mean-field systems, in that their mean energy often admits a representation function involving 
Level- 1 or Level-2 macrostates [ ]. This is the case, for example, for systems of gravitating particles and 
plasmas, which can be investigated in the mean-field or Vlasov limit using the empirical distribution (see 
[34, 35, 52] for recent reviews). Some statistical models of two-dimensional (2D) turbulence can also be 
treated with an energy representation function involving a relatively simple macrostate (see, e.g., [ ]). A 
particularity of these models is that the prior distribution P{duj) is not always chosen to be the uniform 
measure [ ] . Another model worth mentioning, finally, is the so-called a-Ising model in one dimension, 
which admits the local magnetization function as a mean-field [10]. Other models of long-range systems are 
discussed in [ , ]. 

Systems involving short-range interactions are much more complicated to study due to the fact that their 
large deviation analysis must be based on the Level-3 empirical process mentioned in Sec. IV. The empirical 
process can be used in principle to study non-interacting and mean-field models, but this is never done in 
practice, as there are simpler macrostates to work with. The problem with short-range models is that the 
empirical process is, in general, the only macrostate admitting an energy representation function. This is the 
case, for example, for the nearest-neighbor Ising model, which has been studied extensively in one and two 
dimensions from the point of view of the empirical process (see, e.g., [84, 85, 229, 230]). We summarize 
in the next example the equilibrium properties of the mean magnetization of the 2D version of this model, 
obtained by contracting the large deviations of the empirical process down to the mean energy and mean 
magnetization. The main sources for this example ai^e Ellis [ ], Pfister [ ], and Kastner [148]. For a 
discussion of the Ising model in one dimension, see [84, 182]. 

Example V.4 (2D Ising model). Consider the 2D nearest-neighbor Ising model, defined by the usual 
Hamiltonian 

^" = "2^^^^^' ^^£{-1,1}, (179) 

where {i,j) denotes first-neighbor sites on the finite 2D square lattice containing n spins. The entropy of this 
model is sketched, following [148], in Fig. 13 as a function of the mean energy u and mean magnetization m. 
There are many properties of this entropy worth noting from the point of large deviations: 

• s{u, m) is strictly concave in m for u G [uc, 2], where Uc = — \/2, with a maximum located at tti = 0; 
see Fig. 13(b). 

• s(u, m) is concave in ?7i for li G [—2, Uc), but not strictly concave. In fact, for this range of mean 
energies, s{u, m) is constant in m in the interval [—m^{u), rn^{u)]; see Fig. 13(c). The boundary 
point m+(n) is called the spontaneous magnetization, and is such that rn^{uc) = and m'^{u) — > 1 
as ti ^ —2. 

• By contraction, s{u) = s{u, 0), since tti = is always a maximum of s{u, m) for all u G [—2,2]. 
Although not plotted, s{u) is known to be concave and differentiable, which means that it can be 
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s{u,m) 



s(u,m) 



(a) 




s{u,m) 





J"(m) 




FIG. 13: (a) Sketch of the joint entropy s{u, m) of the 2D Ising model (after [ 1 4!]). (b) Projection of s(u, m) as a 
function of ?7i for w < Uc- (c) Projection of s(u, m) as a function of to for u > Uc- (d)-(e) Microcanonical rate function 
J^'-{m) above and below the critical mean energy Uc- 

calculated in principle as the Legendre transform of the canonical free energy calculated by Onsager 
[219]. 

• The rate function J'^ijn) = s{u) — s{u, m) has a unique minimum and zero for [uc, 2], corresponding 
to the unique equilibrium value of the mean magnetization in the microcanonical ensemble for all 

u e [uc, 2]; see Fig. 13(d). 

• For u G [—2,Uc), J'^{m) is zero for all m in the interval [— ?7i"^(u),m+(ii)], which is called the 
phase transition interval ov phase coexistence region { , ]; see Fig. 13(e). 

• In the coexistence region, P^{Mn G dm) decays as e~"^, where a is some positive constant, instead 
of the anticipated (bulk) decay e~^", b > 0. This "slower" large deviation principle describes a surface 
effect related to a change of phase, and depends on boundary conditions imposed on the model (see, 
e.g., [141, 230]). 

The fact that J"(m) is zero over the whole coexistence region when u < Uc means that the large deviations 
of the mean magnetization are undetermined in that region [85, 168]. In particular, we cannot conclude 
from the shape of J^{m) that there is a whole interval of equilibrium values for the mean magnetization. 
The actual equilibrium values are determined by the refined large deviation principle for P"(Af„ G dm) 
mentioned in the last point above. The same remark applies when studying the 2D Ising model in the 
canonical ensemble as a function of the temperature; see Example V.6. 



D. Canonical ensemble 



The canonical ensemble differs from the microcanonical ensemble in the way microstates are weighted. 
In the microcanonical ensemble, the control parameter is the energy U or the mean energy u = U/n, and 
the microstates uj are taken to be distributed according to the constrained prior distribution P"(dc<;), which 
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assigns the same probabilistic weight to all the microstates with the same energy U or mean energy u. In 
the canonical ensemble, the control parameter is the temperature T or, equivalently, the inverse temperature 
P = {ksT)^^, and the relevant probability measure that one considers on A„ is the so-called canonical or 
Gibbs measure 

-l3H„{u}) 

Pf^idu;) = -^-^P{du). (180) 

In this expression, Zn{/3) is the n-particle partition function defined earlier in Eq. (146). We will not discuss 
the physical interpretation of P^(da;), apart from mentioning that it arises as the probability distribution of a 
sample system with Hamiltonian Hn{oj) placed in thermal contact with a heat bath at inverse temperature j3 
(see, e.g.. Sec. 28 of [ ]). It should be mentioned also that, although the expression of Pp{duj) involves the 
exponential function, that expression is not a large deviation principle — it is just the definition of a measure 
onA„. 

The derivation of a large deviation principle for a general macrostate M„(u;) in the canonical ensemble 
proceeds similarly as in the microcanonical ensemble. On the one hand, if an energy representation h{m) 
and a macrostate entropy s{m) exist for M„, it is relatively easy to show that 

Pp{Mn G dm) = / P/3(dw) x e'"'^!'^'^^ dm (181) 

J {uehn:Mn(uj)edm} 

where 

Ip{m) = (ih{m) - s{m) - ip{f3) (182) 

and ip{f3) is the free energy defined in Eq. (147) [""]. On the other hand, if one knows that a joint large 
deviation holds for P{hn € du, Mn G dm) with macrostate entropy s{u, m), then 

Pfi{Mn G dm) X e-"-^'3('") dm, (183) 

where 

J0(m) = inf{/3n - s(u,m)} - ipi(3). (184) 

u 

These two large deviation principles generalize Einstein's theory of fluctuations to the canonical ensemble. 
The rate functions //^(m,) and Ji3{m) that we obtain in this ensemble are the macrostate free energies that 
form the basis of the Ginzburg-Landau theory of phase transitions [ ' (^•^]. 

As in the microcanonical ensemble, the global minima of Ip{m) or Jp{m) define the most probable 
or equilibrium values of the macrostate M„ which now appear in the canonical ensemble with inverse 
temperature (3. The set £p containing these canonical equilibrium values is thus defined as 

£p = {m: Ip{m) = 0} or £i3 = {m: Jfs{m) = 0}, (185) 

depending on the rate function (/^ or Jp, respectively) used for analyzing the canonical large deviations of 
Mn. Equivalently, we have 

Sfj = {m : m, is a global minimum of /^(?n,)} (186) 



or 



<S/3 = {m : m is a global minimum of Ji3{m)}, (187) 
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The canonical analog of the maximum entropy principle that we obtain from these definitions of £p is called 
the minimum free energy principle, and is expressed as 

V3(/3) = inf{/3/i(m) - sim)] (188) 

or 

ip{(3)=mimi{(iu-s{u,m)], (189) 

m u 

depending again on the rate function (/^ or Jjs, respectively) used. These formulae play the same role as 
the maximum entropy principle, in that they enable us to obtain the thermodynamic free energy ^{P) as the 
solution of a variational problem involving a function that we call the macrostate free energy. The solutions 
of this variational principle are the canonical equilibrium values of M„. 

There is connection with the maximum entropy principle of the microcanonical ensemble that can be 
made here. Since the two infima in Eq. (189) can be interchanged, we can used the maximum entropy 
principle of (164) to write 

(/9(/3) = inf inf{/3n — s{u,'m)} = inf < Pu — sup s{u,m) > = inf{/3n — s{u)}. (190) 

u m '"• [ m ) ^ 

We thus recover the basic Legendre-Fenchel transform found in Eq. (148). The formulae (188) and (189) can 
also be derived by recasting the integral defining Z„(/3) as an integral over M„, and by applying Laplace's 
Method to the latter integral [" ' ]. In the case where h{m) and s{m) exist, for example, we can write 

ZniP) X f Q-^Ph{m) p^Mn G dm) X [ Q-n{Ph{^)-s{ni)} ^^ ^ ^~nini{ph{m)-s(m)} ^ (jgj-. 



The class of macrostates for which large deviation principles can be derived in the canonical ensemble 
is exactly the same as in the microcanonical ensemble, since the rate functions of these two ensembles are 
built from the same energy representation function and macrostate entropies. Hence, if a large deviation 
principle holds for some macrostate Mn in the microcanonical ensemble, then a large deviation principle also 
holds for Mn in the canonical ensemble, and vice versa. This is not to say that the two ensembles yield the 
same sets of equilibrium states. There are models for which the microcanonical equilibrium set <S" and the 
canonical equilibrium set £p are equivalent, in the sense that they can be put in a one-to-one correspondence. 
But there are also models for which the two sets are not equivalent. This problem of ensemble equivalence is 
the subject of the next subsection. 

To close our discussion of canonical large deviations, we discuss next two examples of canonical large 
deviations: one involving the mean energy hn, the other the mean magnetization of the 2D Ising model. The 
first example is important for understanding the content of the next section. For a discussion of other large 
deviation results derived in the canonical ensemble, the reader is referred to [10, 84, 85, 86]. 

Example V.5 (Equilibrium mean energy). The probability distribution of the mean energy /i„ in the 
canonical ensemble is 

r — Ti3u 

PpiK e dn) = / Pfsidu;) = ^^jttMK S dn). (192) 

Assuming that the microcanonical entropy s{u) exists, that is, assuming that P(/i„ G du) x e"'*^") du, then 

P^(/i„ G dn) X 6-"^"^") du, Ip{u) = I3u-s{u)-^{(i). (193) 

The mean energy Uj^ realized at equilibrium in the canonical ensemble at inverse temperature /3 is determined 
from this large deviation principle by requiring that Ifsiufs) = 0. Thus, 

ip{P) = inf{/3n - s{u)} = (iup - s{up). (194) 
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(a) 



(b) 



Jg{m) 




Jfj(m) 




FIG. 14: Canonical rate function Jp{ra) for (a) (3 < f3c and (b) f3 > (3c 



By Legendre duality, Ufs must be such that if' {(3) = up if ^{(i) is differentiable. If s{u) is differentiable, 
then we also have s'{up) = /3, thereby recovering the standard thermodynamic definition of the inverse 
temperature. Observe, however, that //3(n) may have many critical points satisfying s'{u) = (3; the global 
minimizer Ufs is only one of them. 

Example V.6 (2D Ising model). The rate function Jp{m) associated with the mean magnetization of the 
2D Ising model in the canonical ensemble is sketched in Fig. 14. This rate function is directly obtained from 
the macrostate entropy s{u, m) discussed in Example V.4 via Eq. (184). The properties of Jp{m) are similar 
to its microcanonical counterpart J^{m). In particular, 

• Jfi{'m) is a symmetric function of m and is convex for all /3 6 R. One difference with J^{m) is that 
Jl3{m) is finite for all m G (—1, 1). 

• For [5 < (3c, J pirn) is strictly convex, which implies that it has a unique global minimum located 
at m = 0; see Fig. 14(a). In other words, for (3 > (3c, mp = is the unique equilibrium mean 
magnetization. 

• For (3 > (3c, Jfsirn) is convex but achieves, as in the case of J^{m), its zero on a whole interval of 
mean magnetizations denoted by [— 7?t,"*"(/3), ■m~^{(3)]; see Fig. 14(b). This canonical phase transition 
interval is such that rn^{(3) — > when P ^ (3c and ?n,+ (/3) —>■ 1 when (3 —>■ (yo. 

• As in the microcanonical case, P{Mn € dm) x q-^V^ with 6 > inside the phase transition interval. 
This "slower" large deviation principle is also a surface effect. 

• The phase transition in the canonical ensemble is second-order, as in the microcanonical ensemble, 
with critical inverse temperature (3c = s'{uc). The critical exponent associated with the phase 
transition is non-trivial, as is well known, because Jfsim) has no Taylor expansion around m = 
above the critical (3c. 

The 2D Ising model is interesting from the point of view of large deviation theory because it shows that 
the interactions or correlations between the components of a system (here the spins) can change the scaling 
of a large deviation principle, and can lead to a breakdown of the Central Limit Theorem and the Law of 
Large Numbers. The breakdown of the Central Limit Theorem is related here to the fact that Jp{m) is not 
locally quadratic around tti = when (3 > (3c- The breakdown of the Law of Large Numbers, on the other 
hand, is related to the fact that J/3{m) does not have a unique concentration point (i.e., global minimum or 
equilibrium state) for /? > (3c- 
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E. Equivalence of ensembles 

We have seen before that not all rate functions / can be obtained as the Legendre-Fenchel transform of a 
scaled generating cumulant function A; only those that ai^e convex are such that / = A*. When applied to 
entropy functions, this observation directly implies that entropy functions that are nonconcave cannot be 
calculated as the Legendre-Fenchel transform of free energies. Consider, for instance, the entropy s{u) as a 
function of the mean energy. Then we have s = (/?* if s is concave in u, but s y^ if* if sis nonconcave in u; 
see Fig. 15. In the first case, namely when s{u) is concave, we say that the microcanonical and canonical 
ensembles are equivalent at the thermodynamic level because s{u) and v?(/3) are then one-to-one related 
by Legendre-Fenchel transform. In the second case, namely when s{u) is nonconcave, we say that the two 
ensembles are nonequivalent at the thermodynamic level, since part of s{u) cannot be obtained from v(/?) 
[88]. What is obtained by taking the Legendre-Fenchel transform of </?(/?) is the concave envelope s**{u) 
rather than s{u) itself; see Fig. 15. Recall that ip = s* always holds, as noted after Eq. (148), so that the 
nonequivalence of the microcanonical and canonical ensembles only goes in one direction: the free energy 
can always be obtained as the Legendre-Fenchel transform of the entropy, but the entropy can be obtained as 
the Legendre-Fenchel transform of the free energy only when the entropy is concave. 

These results and definitions are simple applications of the results that we have discussed before in 
the context of nonconvex rate functions. Further applications arise from what we know about Legendre- 
Fenchel transforms. In particular, the result relating the nonconvexity or affinity of rate functions with 
the nondifferentiability of the scaled cumulant generating function implies at the level of s{u) and ^{fi) 
that, if s{u) is nonconcave or is affine, then <^(/3) is nondifferentiable. Physically, this means that a first- 
order phase transition in the canonical ensemble can arise in two ways from the point of view of the 
microcanonical ensemble: either s{u) is nonconcave or s{u) is affine ['""'']. The latent heat Au of the phase 
transition corresponds in both cases to the length of the affine portion of the concave envelope s**(n) of 
s{u). Indeed, if s**{u) if affine over some open interval {ui,Uh), then c/?(/3) is nondifferentiable at a critical 
inverse temperature (i^ corresponding to the slope of s**{u) over {ui,Uh)', see Figs. 15 and 16. Moreover, 
(p'{l3c + 0) = n^ and if' {[3c — 0) = Uh, so that 

An = c^'(/3e - 0) - (/.'(/?, + 0) = n;, - m. (195) 

The Maxwell or equal-area construction [137, 202] used in physics to calculate the latent heat is nothing but 
the construction of the concave envelope s**{u) ['" ]; see Fig. 16(c). 

These relationships between entropies, free energies, and phase transitions lead us to one last "physical" 
reformulation of a mathematical result that we have discussed before, namely, the Gartner-Ellis Theorem. 
Put simply: If there is no first-order phase transition in the canonical ensemble, then the microcanonical 
entropy is the Legendre transform of the canonical free energy. This follows by noting that if there is no 
phase transition at the level of the free energy or only a second-order phase transition, then the free energy is 
once-differentiable, which implies by the Gartner-Ellis Theorem that the enti^opy can be calculated as the 
Legendre transform of the free energy. Of course, a concave yet affine entropy, such as the entropy s(u, m) 
of the 2D Ising model, can also be calculated as the Legendre(-Fenchel) transform of the free energy, even 
though the latter has a nondifferentiable point. But, as in the case of nonconvex rate functions, it is impossible 
to distinguish from the sole knowledge of the free energy an affine entropy from a nonconcave entropy. 

Examples of models with nonconcave entropies include the mean-field Blume-Emery-Giiffiths model 
[li, 9U, 91], the mean-field Potts model [ 8, 142], some models of plasmas [ ] and 2D turbulence 
[89, 154] mentioned before, as well as models of gravitational systems (see [ ] for a recent review). The 
latter systems were historically the first to be discovered as having nonconcave entropies or, equivalently, 
as having negative heat capacities due to the long-range nature of the gravitational force (see [52, 191]). In 
general, the long-range nature of the interaction in a many-particle system is a necessary, but not sufficient, 
condition for having nonconcave entropies. 

In some cases, the entropy may be concave as a function of u alone but nonconcave as a function of some 



53 



(a) 



(b) 



(c) 






u P u 

FIG. 15: Thermodynamic nonequivalence of the microcanonical and canonical ensembles as related to the nonconcavity 
of the entropy (see also Fig. 9). The Legendre-Fenchel transform of f{l3) yields the concave envelope s**{u) of s{u) 
rather than s{u) itself. The Legendre-Fenchel transform of both s{u) and s**{u) yield <p(/3). 




(b) 



(c) 




Pc 



p 




FIG. 16: (a) Nonconcave entropy s{u) and its concave envelope s**{u). (b) Associated free energy (/3(/?) characterized 
by a nondifferentiable point, (c) Maxwell's construction: The two areas A defined by the intersection of s'{u) and 
s**'{u) are equal. 



Other macrostate. The mean-field ^^ model, for example, has a concave s{u) but a nonconcave macrostate 
entropy s{u, m) involving the mean energy u and mean magnetization m [36, 128, 129]. Thus, although s{u) 
for this model can be calculated in the spirit of the Gartner-Ellis Theorem as the Legendre-Fenchel transform 
of (^(/5), s{u, m) cannot be obtained as the Legendre-Fenchel transform of a free energy function because that 
Legendre-Fenchel transform yields a concave function. The nonconcave s{u, m) can be obtained, however, 
by other methods. One suggested by large deviation theory is to obtain s{u, m) by contraction of another 
macrostate entropy that can hopefully be calculated using the Gartner-Ellis Theorem; see Example V.3. 
The next example discusses the calculation of s{u, m) in the case where this function is concave. 

Example V.7 (Concave entropy involving two macrostates). If the macrostate entropy s{u, m) is concave, 
as in the case of the 2D Ising model (see Example V.4), then it can be expressed as the Legendre-Fenchel 
transform of a free energy function (/?(/?, r]) involving two variables or conjugated fields: one for /i„, the 
other for M„. By analogy with the definition (/?(/?), (/?(/?, rj) is constructed as 



'/'(Ar/) 



lim In 

n^oo n 



-nfihn-nriMn 



P{duj). 



A„ 



The concavity of s{u, m) then implies 

s{u, m) = inf {I3u + rjm — ip{(3, rj)}. 

The free energy ip{l5, r]) can be put in the more familiar form 



ip{P,r]') = lim In / e 



-nl3[hn~ri' Mn 



P{du) 



(196) 



(197) 



(198) 
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by defining rf = —rj/ (5. In this form, (/?(/?, -q') is nothing but the standard canonical free energy ^p{[5) 
of the modified mean Hamiltonian /i'„ = hn — rj'A-In involving the magnetic field t]'. This field is the 
parameter of the canonical ensemble which is conjugated to the mean magnetization constraint M„ = rn, of 
the microcanonical ensemble, whereas /3 is the usual canonical parameter conjugated to the mean energy 
constraint /i„ = u. 

The thermodynamic equivalence of the microcanonical and canonical ensemble is also the basis for the 
equivalence of Gibbs's entropy and Boltzmann's entropy [1 70]. This is the subject of the next example. 

Example V.8 (Boltzmann versus Gibbs entropy). Gibbs's canonical entropy is defined for a discrete set 
of microstates u) as 

SgW) = -Y1 Pp{^)^^Pp{^). (199) 

a;eA„ 

where Pi3{oj) is the canonical probability distribution. From the definition of this distribution, given in 
Eq. (180), we can write 

Sam = n(3 {K)p + In Z„(/?) + In |A„|, (200) 

where {■) a denotes the expectation with respect to P^. The thermodynamic limit of this expression is 

sg{I3) = lim ^^^ = (3up - ^{(3) + In I A| , (201) 

assuming that up is the unique concentration point of hn with respect to Pp, that is, the unique equilibrium 
mean energy at inverse temperature /3. This assumption is justified rigorously if s{u) is strictly concave; see 
Example V.9. In this case, it is known that if {[3) is differentiable for all /? e M and <f'{[3) = up by Legendre 
duality, so that 

SGW) = s{up) + \n\K\. (202) 

Thus, in the thermodynamic limit, the Gibbs entropy sg{/3) is equal (up to a constant) to the Boltzmann 
entropy s{u) evaluated at the equilibrium mean energy value up. This holds again if s{u) is strictly concave. 
If s{u) is nonconcave or is concave but has an affine part, then up need not be unique for a given /?; see 
Example V.9. 

There are many more issues about the equivalence of the microcanonical and canonical ensembles that 
could be discussed; see, e.g., [^ , '']. One that deserves mention, but would take us too far to explain 
completely is that the two ensembles can be conceived as being equivalent or nonequivalent by comparing 
the equilibrium sets, £^ and £p, of each ensemble. This macrostate approach to the problem of ensemble 
equivalence was studied by Ellis, Haven and Turkington [88] (see also [96]), and has been illustrated so far 
for a model of 2D turbulence [ "], as well as some mean-field spin models ['", '"], including a toy spin 
model [ ] based on the nonconvex rate function studied in Example IV.7. The essential result illustrated 
by these models is, in a simplified form, that the microcanonical and canonical ensembles are equivalent 
at the macrostate level if and only if they are equivalent at the thermodynamic level, that is, if and only if 
s{u) is concave. Thus all models with a concave entropy s{u) have equivalent microcanonical and canonical 
ensembles at the macrostate level. For a simple introduction to these results, see [ ]; for the treatment of 
ensembles other than microcanonical and canonical, see [88]. 

The last example of this section explains how the concavity of s{u) determines the behavior of the 
canonical equilibrium mean energy up as a function of /3. This example illustrates in the simplest way 
possible the theory of nonequivalent ensembles developed by Ellis, Haven and Turkington [ ], and completes 
Example V. 5. 
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Example V.9 (Canonical equilibrium mean energy revisited). We have seen in Example V.5 that the 
equilibrium mean energy n^ in the canonical ensemble is given by the zero(s) of the rate function //3(n) 
displayed in (193). The behavior of up as a function of (3 is determined from this rate function by analyzing 
the concavity of s{u). Three cases must be distinguished [266]. For simplicity, we assume that s{u) is 
differentiable in all three cases. 

• s{u) is strictly concave: In this case, //^(m) has a unique zero u^ for all /3 G M such that ip'{P) = up 
and s'{up) = (5. Furthermore, the range of up coincides with the domain of s{u). These two results 
imply that there is a bijection between u and /3: to any u in the domain of s{u), there exists a unique 
j3 such that u = up;to any /5 G M, there exists a unique u in the domain of s{u) such that u = up. 
This bijection is an expression of the Legendre duality between s{u) and <^{f5). 

• s{u) is nonconcave: In this case, Ip{u) has more than one critical point satisfying s'{u) = (5. 
The global minimum up of Ip{u) is one such critical point satisfying the additional condition 
s{up) = s**{up). If s{u) / s**(u), then u ^ up for all /? G M. Therefore, all u such that 
s{u) / s**{u) do not appear in the canonical ensemble as equilibrium values of /i„. This explains 
at the level of the mean energy why there is a first-order phase transition in the canonical ensemble 
when s{u) is nonconcave. 

• s{u) is concave with an affine part of slope [3c- In this case, Ip{u) has a unique zero up for all (i / /3c- 
For (3 = j3c, Ip{u) has a whole range of zeros corresponding to the range of affinity of s(n). This 
range is a coexistence region for the mean energy hn- 

The case of a nonconcave s{u) is illustrated in Fig. 17. 



F. Existence of the thermodynamic limit 

Proving that a large deviation principle holds for a macrostate is equivalent to proving the existence of 
a thermodynamic limit for an entropy function in the microcanonical ensemble, or a free energy function 
in the canonical ensemble. This equivalence is obvious in the microcanonical ensemble, for the statement 
P{Mn G dm) X e"*^"'-' dm is equivalent to the existence of the limit 

lim -lnP(M„ G dm) = s(m). (203) 

71— >oo 77, 

In particular, P{hn G dn) x e"'^^"^ dn if and only if the limit (142) defining s{u) exists. To establish the 
same correspondence in the canonical ensemble, note that the existence of the following macrostate free 
energy for M„: 

(^(r/) = lim --In / e-"''*^"^^) P(da;) (204) 



implies the existence of s(m), since 

s(m) < s**{m) = inf {r/m — ip{r])}. (205) 

The converse of this result also holds by Varadhan's Theorem: namely, ip{r]) exists if s{m) exists. '° As a 
particular case, we thus have that s{u) exists if and only if ^{P) exists; that is, the thermodynamic entropy 
exists if and only if the thermodynamic free energy exists [179, 181]. 



'" Except possibly at boundary points; see Example IV.8. 
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(a) 
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FIG. 17: (a) Generic nonconcave entropy function s{u). (b) Derivative of s{u). The nonconcavity of s{u) translates 
into a non-monotonic derivative s'{u). (c) Canonical rate function Ip{u) for the mean energy, given in Eq. (193). The 
critical points of Ipiu), for a given value of /3, satisfy s'{u) = (3. When s{u) is nonconcave, If3{u) may have more 
than one critical point. The equilibrium mean energy u^ in the canonical ensemble, which corresponds to the global 
minimum of /^(u) (black dot), is always located in the concave region of s{u), i.e., in the region where s{u) = s**{u). 
The unstable (red dots) and metastable (open dot) critical points are located in the nonconcave region, i.e., in the region 
where s{u) j^ s**{u). At f3 — fie, Ipiu) has two global minima corresponding to ui and Uh (phase coexistence). 



Our treatment of large deviation principles avoided, for the most part, any proofs of the thermodynamic 
limit. We either assumed the existence of large deviation principles in order to work out their consequences, 
or we established directly those large deviation principles by deriving their rate functions by contraction 
of other rate functions that are known to exist (e.g., the relative entropy). In the case of mean-field and 
long-range systems, for example, we are often led to prove that s{u) exists simply by calculating this rate 
function with the general maximum entropy principle involving the macrostate entropy s{m) and the energy 
representation function h{m). Short-range models are more difficult to treat because, as mentioned, they 
necessitate the use of the empirical process, the Level-3 macrostate. The calculation of s{u) for these models 
thus involves the contraction of an infinite-dimensional rate function — the relative entropy of the empirical 
process — down to the mean energy hn- 

The existence of s{u) may be established in a more general way by proving the existence of the limit 
defining this quantity for certain classes of Hamiltonians. This method was initiated by Ruelle [242, 244] and 
Lanford [ ] (see also Griffiths [126]), who proved that the limit defining s{u) does exist for interactions 
that are stable, in the sense that they do not lead to a collapse of the particles into a low energy state, and 
are tempered, in the sense that they decay sufficiently quickly at large distances so as to limit surface or 
boundary effects in the thermodynamic limit. The method of proof relies on the notion of super-additivity, 
and establishes as an added result that s{u) is concave, which implies, in turn, that the microcanonical and 
canonical ensembles are equivalent [107, 109, 242]. This result can be extended to macrostates other than 
hn to conclude that macrostates satisfying similar conditions of stability and temperedness have concave 
macrostate entropies. For an introduction to these results, the reader is referred to the work of Lanford [ ' 68], 



57 



who treats a simpler class of short-range interactions and macrostates known as finite-range. 

Proofs of the existence of the canonical free energy ip{P) have also been given, notably by van Hove 
[269, 270], Ruelle [ , ], Fisher [, .], and Griffiths [125, 127]. The class of short-range interactions 
considered in this case is essentially the same as the one mentioned before, namely, stable are tempered. 
One interesting aspect of these proofs is that they also establish the equivalence of the microcanonical 
and canonical ensembles, among other ensembles. Therefore, one condition that appears to be necessary 
(although not sufficient) for having nonconcave entropies and nonequivalent ensembles in the thermodynamic 
limit is for the interaction in a system to be long-range. Gravitating particles, unscreened plasmas, and vortex 
models of 2D turbulence are examples of such long-range interaction systems; see [52] for others. 

VI. LARGE DEVIATIONS IN NONEQUILIBRIUM STATISTICAL MECHANICS 

We turn in this section to the study of large deviations arising in physical systems that dynamically evolve 
in time or that are maintained in out-of-equilibrium steady states by an external forcing. The methodology 
that will be followed for studying these nonequilibrium systems is more or less the one that we followed 
in the previous section. All that changes is the type of systems studied, and the fact that in nonequilibrium 
statistical mechanics the object of focus is most often not the Hamiltonian or the constraints imposed on a 
system, but the stochastic process (Markov chain, Langevin equation, master equation, etc.) used to model 
that system. 

The dynamical nature of nonequilibrium systems requires, of course, that we include time in the large 
deviation analysis, possibly as the extensive parameter controlling a large deviation principle (as is the 
case for the number of particles). Conceptually, this is a minor adjustment to take into account. A more 
fundamental difference between equilibrium and nonequilibrium is that there is no concept of statistical- 
mechanical ensemble for nonequilibrium systems, even those driven in out-of-equilibrium steady states 
[ ] . That is to say, when a system is out of equilibrium, we do not know in general what the underlying 
probability distribution of its states is (if such a distribution indeed exists). To find it, we must define the 
system precisely, calculate the probability distribution of its states from first principles, and proceed from 
there to derive large deviation principles for observables that are functions of the system's state. There is no 
general principle whereby one can calculate the distribution of the system's states from the sole knowledge 
of the system's invariants or external constraints imposed on the system. Such a general principle is precisely 
what a statistical-mechanical ensemble is, and what is missing from the theory of nonequilibrium systems. 

In spite of this, it is possible to formulate a number of general and interesting results for nonequilibrium 
systems, especially when these are modeled as Markov processes. The aim of this section is to give an 
overview of these results in the style of the previous section, with an emphasis on large deviations. We will 
see with these results that it is often possible to characterize the most probable states (trajectories or paths) of 
a nonequilibrium system as the minima of a rate function, and that these minima give rise to a variational 
principle that generalizes the maximum entropy or minimum free energy principles. The knowledge of this 
rate function also provides, as in the case of equiUbrium systems, a complete description of the fluctuations 
of the system considered. 

A. Noise-perturbed dynamical systems 

The first class of large deviation results that we study concerns the fluctuations of deterministic dynamical 
systems perturbed by noise. The idea here is to consider a differential equation, which determines the motion 
of a dynamical system in time, and to perturb it with a Gaussian white noise of zero mean and small intensity 
(variance or power) e > 0. In the presence of noise (e 7^ 0), the system's motion is random, but for a small 
noise, that random motion is expected to stay close to the unperturbed dynamics, and should converge, in the 
zero-noise Umit e ^ 0, to the deterministic motion determined by the unperturbed differential equation. In 
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terms of probabilities, this means that the probability distribution of the system's trajectories or paths should 
concentrate, as e ^ 0, around the deterministic path of the unperturbed system. This concentration effect is 
akin to a Law of Large Numbers, so in the spirit of large deviation theory it is natural to inquire about the 
scaling of that concentration with e; that is, how is the probability decaying around its maximum as e — > 0? 
The answer, as might be expected, is that the decay has the form of a large deviation principle. 

1. Formulation of the large deviation principle 

The Study of large deviations of random paths gives rise to a mathematical difficulty that we encountered 
before when we treated the continuous version of Sanov's Theorem: a trajectory is a function, which means 
that the probabilities that we must handle are probabilities over a function space. A rigorous mathematical 
treatment of large deviations exists in this setting (see, e.g., [ ] or Chap. 5 of [ ]), but for simplicity, 
and to give a clearer presentation of the ideas involved, we will follow the previous sections and deal with 
probabilities of random functions at a heuristic level. To simplify the presentation, we will also start our study 
with a simple, one-dimensional noise-perturbed system described by the following stochastic differential 
equation: 

X,{t) = h{X,) + ^er]{t), X,(0) = xq. (206) 

In this expression, X^ G M, 5 is a real function (sufficiently well-behaved), and r]{t) is a Gaussian white 
noise process characterized by its mean (r/(t)) = and correlation function (^(t)^(t')) = ^{^ ~ *')■ The real 
constant e > is the large deviation parameter controlling the intensity of the noise. For the mathematically 
minded, Eq. (206) should properly be interpreted as the Ito form 

dX,{t) = b{X,) dt + ^/edW{t) (207) 

involving the Brownian or Wiener motion W{t) [ i \ .:]. What we consider in (206) is the naive yet standard 
version of Eq. (207), obtained by heuristically viewing Gaussian white noise as the time-derivative of 
Brownian motion. 

The probability that we wish to investigate is the probability of a trajectory or path of the random 
dynamical system described by Eq. (206), that is, the probability of a given realization {x(t)}[^Q of that 
equation, extending from an initial time t = to some time r > 0. Of course, one cannot speak of the 
probability of a single trajectory, but only of a set of trajectories, and this is where the difficulty mentioned 
above comes in. To avoid it, one may consider the probability that the system's trajectory lies in some 
cylinder or "tube" enclosing a given trajectory {x{t)}'[^Q, or any other finite set of trajectories. 

This way of making sense of probabilities in trajectory space wiU not be followed here; instead, we will 
assume at a heuristic level that there is a probability density P[x] over the different paths {x(t)}[^o of the 
system. Following the physics literature, we denote this density with square brackets to emphasize that it is a 
functional of the whole function x{t). With this notation, we then write a large deviation principle for the 
random paths as Pe[x] x Q-'^'^-^m to mean that P[x] decays exponentially with speed a^ in such a way that 
Oe — > cxD as e ^ 0.^' The rate function J[x\ is a functional of the paths. To be rigorous, we should write this 
large deviation principle as 

p{ sup \X,{t) - x{t)\ < (5 ) X e-^-J\-^\ e -^ (208) 

Vo<t<r / 



" The term "speed" in this context has, of course, nothing to do with the time derivative of the position. The term is used in large 
deviation theory because a^ determines how quickly Pe decays to zero with e; see Appendices B and D. 
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(a) 



(b) 




t=0 



t=t 




FIG. 18: (a) Trajectory starting at xq at time t = and ending at x at time t = t. (b) Time-discretization of the 
continuous- time trajectory. 



where 5 is any small, positive constant. In this form, the rate function is then obtained by the limit 

lim — Inpf sup \X^{t) - x{t)\ < 6] = -J[x\. (209) 

The notation Pf[x\ x q-^-^JM is obviously more economical. 

The large deviation principle associated with the specific system described by Eq. (206) was derived 
rigorously by Freidlin and Wentzell [106, 28'], and through formal path integral methods by Graham and 
Tel [ , ], as well as by Dykman and Krivoglaz [ ] among others.'^ The result, in the path density 
notation, is 



PM 



-J[x\/e 



J[x] 



[x - b{x)Y dt, 



(210) 



where x{t) is any (absolutely) continuous path'^ satisfying the initial condition x(0) = xq- The rate function 
J[x\ is sometimes called the action functional [106] or entropy of the path [68].^^ Notice that J[x\ is positive 
and has a unique zero corresponding to the deterministic path x* (t) satisfying the unperturbed equation 
X* = h{x*). Therefore, ||Xe(t) — a:*(t)|| ^ in probability as e ^ 0. The quadratic form of J[x\ stems 
from the Gaussian nature of the noise r/(t). For other types of noise, in particular correlated (colored) noise, 
Pf[x\ may still have a large deviation form, but with a rate function which is not quadratic or local in time. 
More details on these correlated large deviation principles can be found in [30, 75, 80, 204, 288] (see also 
[207, 208]). 



2. Proofs of the large deviation principle 

The large deviation result displayed in (210) can be proved in many different ways. The simplest, 
perhaps, is to approximate the trajectories {x(t)}[^g in the spirit of path integral techniques by discrete- 
time trajectories {xj}"^^ involving n points equally spaced between t = and t = r at interval At; see 



Onsager and Machlup [220] derived this result for linear equations as far back as 1953 (see also [98, 99, 25 1]). 
'^ That x{t) should be a continuous path does not contradict the fact that the random paths of stochastic equations driven by Gaussian 

white noise are nondifferentiable with probability 1 . Remember that P^ [x\ is a formal notation for the probability that a given 

random path lies inside an infinitesimal tube whose center follows a given smooth path x(t). Thus, what we are interested in is 

the probability that a random path is close to some smooth path x{t), not the probability that a random path /o//ovv5 exactly some 

smooth path a:: (i) [ ]. 
''' The form of J[x\ presented here is the form obtained in the Ito interpretation of the stochastic equation. In the Stratonovich 

interpretation, there is an additional term involving the components of the vector h{x), which vanishes in the zero-noise limit. The 

difference amounts to a Jacobian term in path integrals involving Pt[x\ [136, 138]. 
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Fig. 18. This discretization or "time-slicing" procedure has the effect of transforming the Markov stochastic 
process of Eq. (206) into a Markov chain, for which it is relatively easy to compute the probability density 
p{xi, X2, . ■ ■ , Xn) given the properties of the noise r]{t). The probability density Pe[x] is then obtained from 
p{xi, X2, . . . , Xn) by taking the double limit n -^ oo, At -^ 0. For more details, see Chap. 2 of [162]. 

More interesting from the point of view of large deviation theory is the fact that P^ [x] can be obtained 
from the Gartner- Ellis Theorem by calculating the functional Legendre-Fenchel transform of the scaled 
cumulant generating functional of X^{t), defined as 

A[A;] =lim eln/e'^-^^/A, (211) 

where 

>x,a\ ^ lv{x\ P^{x\ exp ( - / k[t)x{t) dt J . (212) 

The path integral defining the expectation value above can be solved exactly for Gaussian white noise to 
obtain an explicit expression for A[A;] [162, 287]. In this case, the measure T>\x\ on the space of trajectories 
is the Wiener measure. Alternatively, \\k\ can be obtained in the context of the Donsker-Varadhan theory 
from the generator of the Markov process defined by Eq. (206) (see, e.g., [32, 68, 117]). In both cases, J\x\ 
is then expressed as 

J\x\=\^i{k-x-\\kW. (213) 

k 

The same rate function can also be derived from the large deviation point of view by applying the contraction 
principle to the rate function governing the fluctuations of the scaled noise 7?e(t) = \/e?7(t) [ ]■ We show in 
the next example how to obtain the latter rate function from the Gartner-Ellis Theorem. The large deviation 
result obtained for ??e(t) is known in the mathematical literature as Schilder's Theorem [53, 246]. The 
calculation of J[x\ based on the contraction principle follows the presentation of that theorem. 

Example VI.l (Schilder's Theorem). The properties of a Gaussian white noise ry(t) with (r/(t)) = for 

all t and {rj{t)rj{t')) = 5{t — t') are completely determined by its characteristic function: 

G^[k] = (e'^-'^^ = fv[7]] p[r?]e'^'=W''W^* = exp (-^ I k{tf dt\ . (214) 

From this form of Gn[k\, the scaled cumulant generating functional of the scaled noise ?7e(t) = \/e^(t) is 
easily found to be 

A[A;] = lim eln /e'^'^'^/A = - f k{tf dt. (215) 

e^O \ I 1 J 

This result is the functional analog of the log-generating function of a Gaussian random variable with 
zero mean and unit variance; see Example III.l. As in that example, \[k] is differentiable, but now in the 
functional sense. By applying the Gartner-Ellis Theorem, we therefore conclude that ?/e(t) satisfies a large 
deviation principle in the limit e — > with a rate function given by the Legendre-Fenchel transform of \[k] : 

PeM X e-^^'^l/^ I[(t>] = suj>{k ■ cj) - \[k\}. (216) 

k 

In this expression, (f){t) is a given trajectory or realization of the noise r]^{t) starting at (/)(0) = 0. As in the 
non-functional case, we can use the differentiability of \[k] to reduce the Legendre-Fenchel transform above 
to a Legendre transform, given by 



m =k^-<p- X[k^] = / k^{t)<l){t) dt - X[k^], (217) 
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where k^j, is the functional root of 

In the present case, k^{t) = (t){t), so that 

m = (t>-(t^-m = \j <t>{tf^t- (219) 

The expression of this rate function has an obvious similarity with the rate function of the sample mean of 
IID Gaussian random variables discussed in Example III. 1 . 

We are now in a position to derive the rate function J[x\ of X^{t), shown in Eq. (210), from the rate 
function I[(f)] of the scaled Gaussian noise r/e(i). The main point to observe is that Xe{t) is a contraction of 
r7e(t), in the sense of the contraction principle (Sec. 5.6 of [ ]). This is obvious if we note that the stochastic 
differential equation (206) has for solution 

x{t) = xo+ b{x{s)) ds + / 0(s) ds, (220) 

Jo Jo 

where (j){t) is, as before, a realization of r]^{t). Let us denote this solution by the functional /[(p] = x. Using 
the contraction principle, we then write 

cp:j[(p\=x (p:(p=x—b(x) 

which is exactly the result of Eq. (210) given the expression of /[0] found in Eq. (219). 
For future use, we re-write J[x\ as 

J[x]= f L{x,x)dt, L{x,x) = ]-[±{t)-b{x{t))f . (222) 

The function L{x, x) is called the Lagrangian of the stochastic process Xf:{t). The next example gives 
the expression of L{x, x) and J[x\ for a more general class of stochastic differential equations involving a 
state-dependent diffusion term. This class is the one considered by Freidlin and Wentzell [_ ] (see also 
Sec. 5.6 of [53] and [239, 240]). 

Example VI.2 (General stochastic differential equation). Let X^{t) be a flow in W^, d > 1, governed by 
the following (Ito) stochastic differential equation: 

dX,{t) = h{X,) dt + ^ea{X,) dW{t), X,{Q) = xq, (223) 

where b is some function mapping M"' to itself, cr is a square, positive-definite matrix assumed to be 
nonsingular, and W{t) is the usual Brownian motion. For this system, Freidlin and Wentzell [ ] proved 
that Pe[x\ X e~'^[^'"'^ as e ^ with rate function 

J[x\ = \ r [x{t) - 6(x(t))]^ A-1 [x{t) - h {x{t))] dt, (224) 

^ JO 

where A = aa^ is the so-called diffusion matrix. Two technical conditions complete this large deviation 
result. First, to ensure the existence and uniqueness of a solution for Eq. (223), the drift vector b{x) must be 
Lipschitz continuous. Second, the realizations x{t) oi X^{t) for which the rate function J[x\ exists must 
verify the initial condition x(0) = xq, in addition to having square integrable time-derivatives. 
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3. Large deviations for derived quantities 

Once a lai^ge deviation principle has been proved for the path density P^ [x] , the way becomes wide 
open for deriving large deviation principles for all sorts of probabilities using the contraction principle. Of 
particular interest is the probability density 

P,{x,t\xo)= r^ ^V[x]P,[x]. (225) 

J x(0)=xo 

that the process X^{t) reaches a point x at time t = t given that it started at a point xq at time t = 0; see 
Fig. 18(a). Assuming that Pe[x] satisfies a large deviation principle with rate function J[x], it directly follows 
from the contraction principle that P{x, t\xo) also satisfies a large deviation principle of the form 

P,(x,r|xo)xe-^(^'"l^o)/^ (226) 

with rate function given by 

V{x,t\xo)= inf J[x]. {Ill) 

x{t):x{0)=xo ,x{t)=x 

This rate function is also called the quasi-potential. 

The large deviation approximation of P{x, t\xq) is often referred to as a WKB approximation, following 
Wentzel/^ Kramers and Brillouin, who developed a similar approximation in the context of quantum 
mechanics and differential equations [162].^^ The meaning of this approximation follows exactly the 
interpretation of the contraction principle, in that the dominant contribution to the probability of a fluctuation — 
here the observation of x{t) = x starting from x{{)) = xq — is the probability of the most probable path 
leading to that fluctuation. This most probable or optimal path x*{t), which is the path solving the variational 
problem (227), can be determined by solving the Euler-Lagrange equation 



5J[x\ 
5x{t) 



= 0, x(0) = xo,x{t) = X, (228) 

x'{t) 



which has the well-known form 

d dL dL . . , , ^^„ 

:^ 7^ - TT = 0' ^0 = ^0, x{t) = X (229) 

dt ox ox 

in terms of the Lagrangian L{x, x). The optimal path'' can also be interpreted, by analogy with classical 
mechanics, as the solution of the Hamilton-Jacobi equations, 

Bff rlT-f 

x=—, p = - — , H{p,x) = xp- L{x,x), (230) 

which involve the Hamiltonian H{p, x) conjugated, in the Legendre-Fenchel sense, to the Lagrangian 
L{x, x). These observations are put to use in the next example to determine the WKB approximation of the 
stationary distribution of a simple but important Markov process. 



'^ Wentzel the physicist, not to be confused with Wentzell, the mathematician mentioned earlier. 
'* The WKB approximation is also referred to as the eikonal approximation. 

" The optimal path is also called the maximum likelihood path between two fixed endpoints, the phenomenological path [287] or 
the instanton [29, 78]. 
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(a) 



(b) 



(c) 






FIG. 19: (a) Random paths reaching the boundary dD of a region D in a time t. (b) Stable fixed point Xg located in 
D. (c) Separatrix S delimiting the basins of two attracting fixed points. Some paths on the boundary dD lie on the 
separatrix and are attracted by one or the other fixed point depending on whether they start on the left or right of S. 

Example VI.3 (Stationary distribution of the Ornstein-Uhlenbeck process). Consider the hnear equa- 
tion 



X,{t) = -^X,{t) + ^er^{t), 



(231) 



and let Pe{x) denote the stationary probability density of this process which solves the time-independent 
Fokker-Planck equation 



7|:[xPe(x)] + ^ 



dx^ 



0, e > 0. 



(232) 



We know that in the weak-noise limit e — > 0, Pe(x) obeys the WKB form Pe{x) x Q-'^i^)/'^_ To find the 
expression of the quasi-potential V{x), we follow Onsager and Machlup [ ] and solve the Euler-Lagrange 
equation (229) with the terminal conditions x(— oo) = and x(r) = x. The solution is x*{t) = xe^^^~'^\ 
Inserting this back into J[x\ yields V{x) = J[x*] = 7X^. This result can also be obtained in a more direct 
way by expressing the force b{x) as the derivative of a potential, i.e., b{x) = —U'{x) with U{x) = 7x^/2. 
In this case, it is known that V{x) = 2U{x) (see Sec. 4.3 of [ ]). 

The previous example can be generalized as follows. If the zero-noise limit of the stochastic differential 
equation given by Eq. (223) has a unique attracting fixed point Xg, then the quasi-potential V{x) associated 
with the stationary distribution of that equation is obtained in general by 



V[x) = inf J[x\ 

x(t):x(ti)=Xs,x(t2)=x 



(233) 



where ti and ^2 are, respectively, the starting and ending times of the trajectory x{t) (see Sec. 4.2 of [06]). 
In this variational formula, the two endpoints of the interval [^1,^2] are not fixed, which means that they are 
variables of the variational problem. In many cases, however, it is possible to solve the infimum by letting 
ti -^ —00 and by fixing ^2. as we have done in the previous example. For a discussion of this procedure, see 
Sec. 4.3 of [1(J6]. Bertini et al. [' ] give an interesting derivation of the above formula by studying the rate 
function associated with the time-reverse image of the trajectories x{t) determined by Eq. (223). 

The example that follows presents another important problem for which the WKB approximation is 
useful, namely, that of estimating the average time of escape from an attractor 

Example VI.4 (Exit time from an attractor). An attracting fixed point Xg of a dynamical system does not 
remain attracting in the presence of noise: for e 7^ 0, there is a non-zero probability, however small, that a 
trajectory starting in the vicinity of Xg will be "pushed" by the noise out of some bounded region D enclosing 
Xg-, see Fig. 19(a). The probability that such an escape occurs is very small, and decreases to zero as e ^ 0. 
Consequently, the random time needed for the system to reach the boundary dD of D, which is defined as 



r, = inf{t : x{t) G dD}, 



(234) 



64 



should increase in some probabilistic sense as e — > 0. This time r^ is called the escape- or exit-time from D. 
The calculation of r^ is a classical problem in nonequilibrium statistical mechanics (see, e.g., [115,27' ]), 
and was solved on the mathematical front by Freidlin and Wentzell [ ], who treated it in the context of the 
general stochastic equation (223). Their main result assumes that the unperturbed dynamics associated with 
Eq. (223) has a single attracting fixed point Xg located in D, and that all the points on dD are attracted to Xg, 
so that the case of a boundary dD lying on a separatrix is excluded; see Fig. 19(c). Under these assumptions, 
the following limit then holds: 

lim pUy-^)/- < Te < e(^*+^)/^) = 1, (235) 

e— >0 

where 

V* = inf inf Vix,t\xs) (236) 

and 5 is any small positive constant. Moreover, 

lim eln(r,) = V*. (237) 

e— >0 

The first limit shown in (235) states that the most probable escape time scales as r^ x e^* /'^ as e — > 0. From 
this concentration result, the second limit follows. 

The complete proof of these results is quite involved; see Sec. 4.2 of [ ] or Sec. 5.7 of [ "]. However, 
there is a simple argument due to Kautz [ ] that can be used to understand the second result stating that 
(r^) X e^*/*^. The essential observation is that the average time {t^) of escape is roughly proportional to the 
escape rate r^, which is itself proportional to the probability P^^'^ of escaping D. Thus (r^) oc l/P^^'^, where 

p pco 

PI''' = I dx dtPe{x,t\xs). (238) 

JdD Jo 

Applying Laplace's approximation to this integral yields P^'^^ x e~'^*''^ with V* given by Eq. (236), and 
therefore (r^) x e^*/^, as Eq. (237). The result of Freidlin and Wentzell is more precise, since it provides a 
Law of Large Numbers for r^, not just an estimate for (r^). 

The two previous examples are representative of the way large deviation techniques can be applied for 
calculating stationary probability densities Pe{x) and fixed-time probability densities Pe{x, t\xo), as well 
as exit times and exit points. The second example, in particular, can be used to derive a whole class of 
Arrhenius-type results of the form r^ x e^*/*^ for diffusion- or thermally-induced escape processes, including 
Kramers's classical result for the escape time of a Brownian particle trapped in a potential [' 5, 271]. In the 
specific context of systems perturbed by thermal noise, the variational principle expressed by Eq. (236) is 
often referred to as the principle of minimum available energy, since V* can be shown to be proportional to 
the activation energy, that is, the minimum energy required to induce the escape [150, 151]. An application 
of this principle for Josephson junctions is discussed by Kautz [l^tJ, 151]. 

For practical applications, it is important to note that Freidlin-Wentzell can be generalized to nonlinear 
systems having multiple attractors Ai, i = 1,2,.... For these, the escape time T^^i from a domain Di of 
attraction of Ai is estimated as 

re,iXe^»*/S V*= mf mfV{x,t\xi), (239) 

x^oDi t>0 

where Xi is an initial point chosen inside A^. For more than one attractor, the quasi-potential V{x) character- 
izing the stationary distribution Pe{x) over the whole state-space is also estimated as 

V{x)=miVi{x), (240) 
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where Vi{x) is the quasi-potential of Pe{x) restricted to the attractor Ai, i.e., the quasi-potential of a stationary 
probability density obtained by initiating paths inside Ai [106, 240]. One important characteristic of many- 
attractor systems is that V{x) is in general nonconvex, in addition to being nondifferentiable at points x lying 
on a separatrix (see, e.g., [106, 123, 124, 143]). Mathematically, this arises because the infimum of Eq. (240) 
switches abruptly on a separatrix from one (generally smooth) quasi-potential Vi {x) to another. A similar 
switching phenomenon was observed in the simpler context of sample means in Example IV.7. 

4. Experimental observations of large deviations 

Optimal paths and exit times are not just mathematical constructs — they can be, and have been, observed 
experimentally. The reader is refered to the extensive work of Dykman, Luchinsky, McClintock and 
collaborators [76, 77, 188, 189] for a discussion of many properties of optimal paths observed in analog 
electronic circuits, including symmetry properties of these paths with respect to time inversion [_ J, and 
their singular patterns near coexisting attractors [ 6]. All of these topics are reviewed in the excellent survey 
paper [ 1 90], which also discusses experimental measurements of exit times. 

B. Phenomenological models of fluctuations 

Equilibrium statistical mechanics is a static theory of thermodynamics fluctuations: it provides a basis for 
calculating the probability of fluctuations of given macrostates, but says nothing about how these fluctuations 
arise in time. To describe the dynamics of these fluctuations, we must consider dynamical models of 
many-particle systems, and infer from these models the dynamical — and possibly stochastic — equations 
that govern the evolution of the macrostates that we are interested to study. Such a microstate-to-macrostate 
reduction of the dynamics of a many-body system is, as is well known, very difficult (if not impossible) to 
work out in practice, and so more modest approaches to this problem are usually sought. The most basic is 
the phenomenological approach, which consists in assuming that the time evolution of a macrostate, say M„, 
follows a given stochastic dynamics of the form 

Mn{t)=h{Mn)+Ut), (241) 

where h{Mn) is a force field, and in{t) is a noise term that models the fluctuations of Mn{t). The term 
"phenomenological" indicates that the dynamics of Mn is postulated on the basis of a number of physical 
and mathematical principles, rather than being derived directly from an n-particle dynamics. Among these 
principles, we note the following: 

1. The unperturbed dynamics m = h{m) should represent the macroscopic (most probable) evolution of 

Mn{t)- 

2. The intensity of the noise ^n{t) should vanish as n — > oo to reflect the fact that the fluctuations of M„ 
vanish in the thermodynamic limit; 

3. Given that the fluctuations of M.^ arise from the cumulative and (we assume) short-time correlated 
interactions of n particles, the noise ^n{t) should be chosen to be a Gaussian white noise with zero 
mean; 

4. The stationary probability distribution associated with Eq. (241) should match the equilibrium proba- 
bility distribution of Mn determined by the statistical ensemble used to describe the n-particle system 
(at equilibrium). 
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The second and third points imply that ^n{t) should satisfy (^n(^)) = and {Cn{t)Cn{t')) = bnS{t — t'), 
with 6„ ^ as n ^ oo. The precise dependence of 6„ on n is determined self-consistently, following the 
last point, by matching the large-n form of the stationary distribution of Eq. (241) with the large deviation 
form of the equilibrium (ensemble) probability distribution of M„. This is explained in the next example. 

Example VI.5 (Equilibrium fluctuations). Consider a macrostate Mn satisfying an equilibrium large 
deviation principle of the form 

p(M„ = m) xe-""^(""), (242) 

where I{m) is any of the rate functions arising in the microcanonical or canonical ensemble, and a„ is 
the speed of the large deviation principle. ^^ If /(m) has a unique global minimum, then we know from 
Example VI.3 that the stochastic dynamics 

Mn{t) = -h'{Mn)+Ut) (243) 

has a stationary density given by p{Mn = m) x e-H^)/bn fQj- small bn- By matching this asymptotic with 
the large deviation principle of (242), we then obtain bn = a~^. Thus, if the speed a„ of the large deviation 
principle is the number n of particles, as is typically the case, then bn = n~^. Near phase transitions, the 
speed of a large deviation principle may change (see Examples V.4 and V.6), and this should be reflected in 

bn- 

Models of fluctuation dynamics based on the phenomenological model of Eq. (241) or the more specific 
equation found in (243), based on the rate function I{m), are used to answer a variety of questions, such as: 



• 



What is the most probable fluctuation path {m{t)}J^Q connecting over a time r the equilibrium or 
stationary value m* of M„ to some other value m ^ m* ? 

• What is the most probable decay path connecting the nonequilibrium state M„(0) = m to the 
equilibrium state Mn{T) = m*l 

• Is there a relationship between a given fluctuation path and its corresponding decay path? For instance, 
are decay paths the time-reverse image of fluctuation paths? 

• What is the typical or expected time of return to equilibrium? That is, what is the typical or expected 
time r for which Mn{T) = m* given that M„,(0) = m / m*l 

• If I{m) has local minima in addition to global minima, what is the typical time of decay from a local 
minimum to a global minimum? In other words, what is the typical decay time from a metastable 
state? 

It should be clear from our experience of the last subsection that all of these questions can be answered 
within the framework of the Freidlin-Wentzell theory of differential equations perturbed by noise. In the 
thermodynamic limit, fluctuation and decay paths are optimal paths, and can be determined as such by the 
variational principle of Eq. (227), the Lagrangian equation (229) or its Hamiltonian counterpart, Eq. (230). 
These equations also hold the key for comparing the properties of decay and fluctuation paths. As for the 
calculation of decay times from nonequilibrium states, including metastable states, it closely follows the 
calculation of exit times that we have discussed in the previous subsection (see also [217, 218]). 



'^ Recall that in the microcanonical ensemble, I{m) is interpreted as an entropy function, whereas in the canonical ensemble, I{m) 
is interpreted as a free energy function; see Sec. V. 
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Other results about nonequilibrium fluctuations can be translated in much the same way within the 
framework of the Freidlin-Wentzell theory. The minimum dissipation principle of Onsager and Machlup 
[ ], for example, which states that the fluctuation and decay paths of equilibrium systems minimize some 
dissipation function, can be re-interpreted in terms of the variational principle of Eq. (227), which determines 
the optimal paths of noise-perturbed systems. The next example is intended to clarify this point by explicitly 
translating the theory of Onsager and Machlup into the language of large deviations. For simplicity, we 
consider the dynamics of a single, one-dimensional macrostate. 

Example VI.6 (Linear fluctuation theory). The linear theory of equilibrium fluctuations proposed by 
Onsager and Machlup [ ] (see also [98, 99]) is based on what is essentially a linear version of Eq. (243), 
obtained by assuming that I{m) has a unique and locally quadratic minimum at m* = 0, and that M„ 
fluctuates close to this equilibrium value. By approximating I{m) to second order around its minimum 

I"(0) 
I{m) « am^, a = —^ > 0, (244) 

we thus write 

M„(t) = -aM„(t)+e„(t). (245) 

The scaling of ^n{t) with n is not specified by Onsager and Machlup [ ], but it is obvious from their 
analysis that, if Eq. (245) is to have a macroscopic limit, then the variance of the noise should scale inversely 
with the number n of particles, as explained in Example VI.5. In this case, we can write the path probability 
density Pn["i] of M„(t) as 

Pn[m] X e-"^[™l, J[m] = \ f [m{t) + am{t)f dt (246) 

2 Jo 

in the limit of large n, which is more or less what Onsager and Machlup obtain in [220]. The Lagrangian of 
this rate function can be re-written as 

livfi) 

L{m, m) = $(m) + ^(m) + ^ — - {lAl) 

by defining what Onsager and Machlup call the dissipation functions $(m) = rn? /2 and ^(m) = a^m? /2. 
With this form of L{'m, m), a fluctuation path is then characterized as a path that globally minimizes 



/ 

Jo 



[2$(m) + 2^(m) + /(m)] dt = I{m{T)) - /(m(0)) + 2 / [$(m) + ^{m)\ dt (248) 

io 



JO 

subject to the terminal conditions ?7i(0) = and m{T) = m, / 0. This variational principle is equivalent to 
the general variational principle of Eq. (227), and is what Onsager and Machlup refer to as the minimum 
dissipation principle [ ]. The decay path bringing an initial fluctuation m,(0) = m, 7^ back to the 
equilibrium point m* = also satisfies this principle, but with the terminal conditions exchanged, i.e., with 
m(0) = m and m{T) = 0. 

From the symmetry of the associated Lagrange equation, it can be shown that the decay path is the 
time-reverse image of the corresponding fluctuation path. This holds, in general, whenever the dynamics of 
Mn{t) is derived from a quasi-potential I{m), that is, when m* is an equilibrium state in the thermodynamic 
sense. When the dynamics of Mn{t) involves external forces or non-conservative forces (in more than one 
dimension), the forward and backward optimal paths need not be the time-reverse of one another; see [190] 
for examples. In this case, m* is called a stationary state rather than an equilibrium state. 

The linear model of Onsager and Machlup serves as a template for constructing and studying other models 
of fluctuation dynamics, including models of nonequihbrium steady states (see, e.g., [133, 257, 258]), and 
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for ultimately building a general theory of nonequilibrium processes (see, e.g., [16, 95, 122, 223, 227, 252]). 
In going beyond this model, one may replace the linear force b{m) = —am by nonlinear forces, consider 
noise processes with a non-zero mean or noise processes that are correlated in time, in addition to studying 
several (possibly coupled) macrostates rather than just one as we did in the previous example. One may also 
model the fluctuations of a field p{x, t) using a general equation of the form 

dtp{x,t) = D{p{x,t))+i{x,t), (249) 

where D is some operator acting on p{x,t), and ^(x,f) is a space-time noise process. Stochastic field 
equations of this form are known as hydrodynamic equations, and are used to model turbulent fluids 
[41, 100, 120], as well as the macroscopic dynamics of particles evolving and interacting on lattices 
[95, 158, 250]; see Sec. VID. Note that for a field p{x, t), the analog of the path probability density P[m] of 
Mn{t) is the functional probability density P[p] = P{{p{x, t)}[=o)' which gives the probability density that 
p{x, t) follows a given "trajectory" or history {p{x, i)}[=o ^^ some function space. 

In the next subsection, we will apply methods inspired from the results of Onsager and Machlup to study 
the fluctuations of physical observables defined as time-averages over the paths of stochastic systems. 

C. Additive processes and fluctuation relations 

The large deviation results that we have surveyed so far were mostly concerned with the trajectories or 
paths of stochastic processes, and the probability density of these paths. Here we shall be concerned with 
random variables defined on these paths as additive functionals of the form 

Ar[x] = - r f{x{t))dt, (250) 

T Jo 

where / is a smooth function mapping the state x{t) of some stochastic process X{t) to W^, d > 1. The 
random variable A[x] is called the time-average of f{x{t)) over the time interval [0, r]. The usual problem 
that we are concerned with is to investigate whether, for a given stochastic process X{t), A^ satisfies a large 
deviation principle and, if so, to determine its rate function. 

1. General results 

As in the case of sample means of random variables, a large deviation principle can be derived for A^-, at 
least in principle, via the Gartner-Ellis Theorem. The scaled cumulant generation function in this case is 

A(A;) =_lim iln(e^'=-^-), k£ 
where 

and P[x] is, as before, the probability density over the paths {x{t)}l^Q extending from t = to t = r. 
Provided that X{k) exists and is differentiable, we then have 

P{Areda)>ie'^^^^^da, I {a) = sup{k ■ a - X{k)} . (253) 

k 

If X (t) is an ergodic Markov process, the large deviations of Ar can be determined, also in principle, using 
the Donsker-Varadhan theory of Markov additive processes. In this case, A(fc) is evaluated as the logarithm 



(251) 
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of the largest eigenvalue of the operator Lk = L -\- k ■ f, L being the generator of the stochastic process X{t) 
[65, 66, 67]; see also Sec. V.A of [ ] and [ ].^^ This result is the continuous-time generalization of the 
result of Sec. IV C stating that, for an ergodic Markov chain, A(A;) is given by the logarithm of the largest 
eigenvalue of the "tilted" transition matrix 11^. An important example of additive random variables, which 
has been extensively studied by Donsker and Varadhan [65, 66, 67], is presented next. 

Example VI.7 (Occupation measure). Let 1^(2;) denote the indicator function for the set A which equals 
lit X € A and otherwise. The time-average of this function, given by 

Mr{A) = - riA{x{t))dt, (254) 

T Jo 

gives the fraction of the time r that the path {x{t)}J^Q spends in A, and plays, as such, the role of the 
empirical vector for continuous-time dynamics. To make the connection more obvious, take A to be an 
infinitesimal interval [x, x + dx] anchored at the point x. Then Mr{dx) = Mt-{[x, x + dx]) "counts" the 
number of times x{t) goes inside [x, x + dx]. The density version of MT-(dx), defined as 

Lr(x) = - I 6(x(t)-x)dt, (255) 

T Jo 

"counts", similarly as for the empirical density defined in Eq. (90), the number of times that x(f ) hits a given 
point X as opposed to an interval of points.^" 

For many stochastic processes, L-j- is observed to converge in probability to a given stationary density in 
the long-time limit r ^ 00. The fluctuations of Lr around this concentration point can be characterized by a 
rate function, which can formally be expressed via the Gartner-Ellis Theorem as 

I[^i] = sup{n- k - X[k]}, (256) 

k 

where 

fi ■ k = fi{x)k{x)dx (257) 

and 

A[A;] = lim - In /exp | / k{x{t)) dt\\ . (258) 

This result can be found in Gartner [117]. More explicit expressions for I[fi\ can be obtained from the 
general Legendre-Fenchel transform shown in Eq. (256) by considering specific random processes X{t). In 
the particular case of an ergodic Markov process with generator G, Donsker and Varadhan obtained 

j[^] = _ inf /^\ = - inf /;,(x)i^^dx. (259) 

«>o \ u / u>oJ ' n(x) 

as part of their general theory of large deviations of Markov processes [65, 66, 67] (see also Sec. VB of 
[32]). This rate function is the continuous-time analog of the rate function presented in Example IV.5. As in 
that example, the minimum and zero of /[/i] is the stationary probability density p* of the ergodic Markov 
process generated by G. The rate function /[//] characterizes the fluctuations of Lj- around that concentration 
point. 



" There is a mathematical difficulty that will not be discussed here, namely, that the largest eigenvalue of Lk has to be isolated in 

order for the large deviation principle to hold. 
^° Lt{x) is a density, so the number of times that x(t) hits the interval [x,x -{- dx\ is actually Lt{x) dx. 
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The next example shows how a large deviation principle can be derived for Aj- when the stochastic process 
X{t) falls in the Freidlin-Wentzell framework of stochastic differential equations perturbed by Gaussian 
noise. The large deviation principle that one obtains in this case applies in the limit of vanishing noise, which 
is different from the r ^ oo limit that we have just considered. 

Example VI.8. Consider a general Markov process Xe{t) arising, as in Sec. VIA, as the solution of a 
dynamical system perturbed by a Gaussian white noise of strength e, and let Aj- [x] be a time average defined 
over X^{t). From the Freidlin-Wentzell theory, we know that the large deviation principle P[x] x e"*^'^]/*^ 
applies in the small noise limit e ^ 0, with rate functional J[x] given by Eq. (210). Since At is a functional 
of X^{t), the contraction principle immediately implies that A-j- also satisfies a large deviation principle in 
the limit e — > 0, with rate function I{a) given by the contraction of J[x]: 

I (a) = inf J[x]. (260) 

x{t):AT[x]=a 

As always, we can use Lagrange's multiplier method to transform this constrained maximization into an 
unconstrained optimization problem. This was done in Example IV. 10 for the contraction of Sanov's Theorem, 
as well as in Example V. 1, which illustrated the maximum entropy principle. The unconstrained functional 
that we have to optimize in the present case is K[x] = J[x] — f3Ar[x], and involves the Lagrange multiplier 
/3 which takes care of the constraint A-j- [x] = a. 

Although the large deviation principle obtained in the previous example applies, strictly speaking, in 
the limit e — > 0, it can often be transformed into a large deviation principle for Ar in the limit r ^ co by 
studying the extensivity of /(a) with r (see, e.g., [227, 257]). The large deviation principle that one obtains 
in this case applies in the dual limit r ^ oo and e ^^ 0, which means that it is only an approximation of 
the large deviation principle that governs the fluctuations of Ar in the limit t —>■ oo for an arbitrary noise 
power e, i.e., without the limit e — > oo. In technical terms, this means that the knowledge of the optimal path 
solving the variational principle (260) is in general not sufficient to derive the long-time large deviations of 
A-J- for any noise power. The only exception to this statement, noted by Onsager and Machlup [ ], are 
linear stochastic differential equations, i.e., linear Langevin equations. For these, the evaluation of a path 
integral by its most probable path actually gives the exact value of the path integral for all e > 0, up to a 
normalization constant, which can usually be omitted for the purpose of deriving large deviation results. 

2. Fluctuation relations 

The next example is concerned with the large deviations of an additive process often studied in nonequi- 
librium statistical mechanics. This example is also our point of departure for studying large deviations of 
nonequilibrium observables, that is, random variables defined in the context of nonequilibrium systems, and 
for introducing an important class of results known sl^ fluctuation relations ov fluctuation theorems. 

Example VI.9 (Work fluctuations for a Brownian particle [275]). Consider a Brownian particle im- 
mersed in a fluid, and subjected to the "pulling" force of a harmonic potential moving at constant velocity Vp. 
The dynamics of the particle is modeled, in the overdamped limit, by the Langevin equation 

x{t) = -[x{t) -v.pt] +Q{t), (261) 

where x{t) denotes the position of the particle at time t, with x(0) = 0, and C,{t) is a Gaussian white noise 
characterized by {C,{t)) = for all t and {({t)C{t')) = 25{t — t')?^ The workper unit time or intensive work 



"' Dimensional units are used here; see [_ _ ] for tlie full, physical version of this equation. 
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Wr done by the pulling force F{t) = —[x{t) — Vpt] over an interval of time [0, r] has for expression: 

Wr = -[ VpF{t) dt = -^ / [x{t) - Vpt] dt. (262) 

T Jo T Jo 

The large deviation principle governing the fluctuations of this additive process is found, following the 
Gartner-Ellis Theorem, by calculating the scaled cumulant generating function X{k) of WV- This calculation 
can be performed using various methods (e.g., characteristic functions [275], differential equation techniques 
[265], path integrals [_. . ], etc.), which all lead to 

X{k)=ck + ck'^ = ck{l + k), (263) 

where c = (vp)'^. Since this function is quadratic, the rate function of Wr given by the Legendre-Fenchel 
transform of X{k) must also be quadratic, which implies that the fluctuations of Wr are Gaussian. To be 
more precise, let p{Wr = w) denote the probability density of Wr- Then 

p(Wr = ti;) X e-^^^"'), I(w) = mUkw - \(k)} = ^^ ~ ^^ . (264) 

k 4c 

The main conclusion that we draw from this result is that positive amounts of work done by the pulling force 
on the Brownian particle are exponentially more probable than negative amounts of equal magnitude, since 
c > for Vp y^ 0. To make this more obvious, consider the probability ratio 

RrH = ^15- = "\ . (265) 

p[Wr = -W) 

Given the quadratic form of I{w), it is easy to see that 

Rr{w) X e^[^(-"')-^("')] = e™. (266) 

Accordingly, the probability that Wr = w > is, in the large time limit, exponential larger than the 
probability that Wr = —w. 

The study of the probability ratio Rr{w) for physical observables other than the work Wr defined above 
has become an active topic of study in nonequilibrium statistical mechanics; see [131, 164, 196, 200] for 
theoretical surveys of this topic, and [94, 237] for more experimental surveys. The importance of Rr{w) 
is justified by two observations. The first is that Rr {w) provides a measure of how "out of equilibrium" a 
system is, since it yields information about the positive-negative asymmetry of nonequilibrium fluctuations 
that arises in general because of the irreversibility of the fluctuations paths [20, 194]. The second observation 
is that the precise exponential form of Rr{w) displayed in (266) appears to be a general law characterizing 
the fluctuations of several different nonequilibrium observables, not just the work Wr considered above. A 
precise formulation of this law, now commonly referred to as the fluctuation theorem [ill, 112], can be 
given as follows. Let Ar denote a nonequilibrium observable integrated over a time interval r. For simplicity, 
let us assume that Ar is a real random variable, and that p{Ar = a) is non-zero for all a G M. Then Ar is 
said to satisfy the fluctuation theorem if 

in the limit of large r, with c a constant independent of a and r. Equivalently, Ar satisfies the fluctuation 
theorem if 

1 
Q{a) = lim -\x\Rr{a) = ca. (268) 

r— >oo T 
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The expression "fluctuation theorem" should be used, strictly speaking, when the asymptotic result of (267) 
or (268) is proved for a specific nonequilibrium observable. When this result is experimentally or numerically 
verified rather than being proved, the expression "fluctuation relation" is more appropriate. 

The first observation of a fluctuation relation was reported by Evans, Cohen and Morriss [)?i], who 
numerically studied the fluctuations of sheared fluids. Based on these results, Gallavotti and Cohen [ill, 112] 
then proved a fluctuation theorem for the entropy rate of chaotic, deterministic systems, which was later 
extended to general Markov processes by Kurchan [ ], Lebowitz and Spohn [ ], and Maes [ ]. These 
results form the basis of several experimental studies of fluctuation relations arising in the context of particles 
immersed in fluids [4, 285], electrical circuits [4, 116, 273], granular media [6, 102, 234, 282, 283], turbulent 
fluids [44, 45], and the effusion of ideal gases [ ' '], among other systems. The next example gives the essence 
of the fluctuation theorem for the entropy rate of Markov processes. This example is based on the results 
of Lebowitz and Spohn [172], and borrows some notations from Gaspard [ ] (see also [42, 43]). For a 
discussion of the entropy production rate based on the Donsker-Varadhan rate function of the empirical 
measure, the reader is referred to [ 1 95] . 

Example VI. 10 (Entropy production). Let ex = cii, ct2, ..., cr„ be the trajectory of a discrete-time ergodic 
Mai^kov chain starting in the state ui at time 1 and ending with the state an at time n. Denote by a^ the 
time-reversed version of a obtained by reversing the order in which the states o"i , o"2 , . . . , o"„ are visited in 
time, that is, a^ = Un, o"n_i, . . . , cji. If the Markov chain is reversible, that is, if P{(t) = P{a^) for all a, 
then the entropy production rate of the Markov chain, defined as 

^n{'y) = -\n^^ (269) 

equals zero for all a. Accordingly, to study the irreversibility of the Markov chain, we may study how Wn 
fluctuates around its mean {Wn), as well as how the mean differs from zero. 

For an ergodic Markov chain, the Asymptotic Equipartition Theorem mentioned in Sec. IV E directly 
implies [119, 146] 

lim {Wn) = h^-h, (270) 

71— >00 

where h is the. forward entropy rate defined in Sec. IV E, and h^ is the backward entropy rate, defined as 

h^= lim --S" P{a)\nP{a^). (271) 

To find the rate function governing the fluctuations of Wn around its mean, note that 

Pi'^f _^^Df R^ P{(T^^^^ 



- > = T.fi-)iKjh = T.^(-'')iBwT,- P'2) 



^nkWn 

'"'"P(a-R)'^ ~^^' ^" V(a«)'=+i' 



Summing over the time-reversed trajectories a^ instead of a leads to 

P(a)'=+l Y- ,P((T^)'=+l 



« > = T.fi-'')iBw = T.f(-r-fU^- P'3) 



^nkW„ 

'p(CT^)fc+i ~Z^" ^"^ P{a)k+^ ■ 



Thus (e"'^^") = (e"(-i-'=)M^") and 

X{k) = lim - In /e"'='^"\ = A(-l - k) (274) 
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for all k G M.p- From the Gartner-Ellis Theorem, we therefore obtain 

I{w) = sViY>{kw — \{k)} = sup{A;t(; — A(— 1 — k)} = I{—w) — w (275) 

k k 

and, consequently, q{w) = li—w) — I{w) = w. This shows, as announced, that Wn satisfies the fluctuation 
theorem. 

The fluctuation theorem for Wn can be generalized to continuous-state and continuous-time Markov 
processes by adapting the definition of the entropy production rate to these processes, and by studying the 
time reversibility of their paths or, equivalently, the time reversibility of the master equation governing the 
evolution of probabilities defined on these paths (see, e.g., [20, 139, 163, 172, 193, 197, 247]). In the case of 
ergodic, continuous-time Markov processes, the symmetry of A(A;) expressed in Eq. (274) can be related to a 
time-inversion symmetry of the processes' generator [ "^^, '"'"']. This time-inversion symmetry can also be 
used to prove fluctuation theorems for other nonequilibrium observables related to the entropy production 
rate, such as the work [20, 163]. 

3. Fluctuation relations and large deviations 

Fluctuation relations and fluctuation theorems are intimately linked to large deviation principles, as is 
obvious from the theory and examples studied so far. In a sense, one implies the other. This equivalence was 
observed by Gallavotti and Cohen in their original derivation of the fluctuation theorem [ill, 112] (see also 
[108, 1 10]), and can be made more explicit by examining the chain of equalities displayed in (275). To put 
these equalities in a more general light, let us consider a general nonequilibrium observable Ar integrated 
over a time r, and let A(A;) be its scaled cumulant generating function. By re-stating the result of (275) for 
Ar, it is first obvious that, if \{k) satisfies the conditions of the Gartner-ElHs Theorem (differentiability and 
steepness), in addition to the symmetry property \{k) = X{—k — c) for all /c G M and c a real constant, then 
Q{a) = ca. By inverting the Legendre-Fenchel transform involved in (275), we also obtain the converse 
result, namely that, if Ar satisfies a large deviation principle with rate function I {a), and g{a) = ca for some 
real constant c, then A(A;) = X{—k — c). By combining these two results, we thus see that the symmetry 
X{k) = A(— c — k) is essentially equivalent to having a fluctuation theorem for Ar- 

When applying these results, it is important to note that the symmetry property X{k) = X{—k — c) can 
be satisfied even if the generating function of Ar satisfies the same property but only approximately in the 
limit of large r. In Example VI. 10, it so happens that this property is satisfied exactly by the generating 
function. Moreover, for processes having a countably-infinite or continuous state space, A(A;) does not exist 
in general for all fc G M, but only for a convex subset of M (see Examples IV.3 and IV.8). In this case, results 
similar to those above apply but in a pointwise sense. That is, if X{k) is differentiable at k and satisfies the 
symmetry A(A;) = A(— A; — c) for the same value k, then g{a) = ca for a such that a = X'{k)}^ To formulate 
a converse to this result, we can follow the same arguments as above to prove that, if X{k) / X{—k — c) for 
at least one value k, then g{a) is not proportional to a for at least one value a. Therefore, if A(A;) satisfies the 
symmetry property only for a subset of M, then Q{a) = ca only for a subset of the values of Ar- In this case, 
we say that Ar satisfies an extended fluctuation theorem. 

To make sure that extended fluctuation theorems are not confused with the fluctuations theorems defined 
at the start of this section, it is common to refer to the latter ones as conventional fluctuation theorems 
[200, 274, 276]. Thus an observable Ar is said to satisfy a conventional fluctuation theorem if its fluctuation 
function g{a), defined by the limit of (268), is linear in a, i.e., if Q{a) = ca. If Q{a) is a nonlinear function 



"^ The convergence of A(fc) for all fc G R follows from the assumption that the space of a is finite; see Sec. IV C. 

^^ This follows by applying the local Legendre transform of Eq. (82), which we have discussed in the context of nondifferentiable 



points of A(fc) and nonconvex rate functions; see Sees. IV A and IV D. 
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of a, then A-j- is said to satisfy an extended fluctuation theorem. The reader will judge by him- or herself 
whether these definitions are useful. In the end, it should be clear that the rate function I{a) completely 
characterizes the fluctuations of A^- in the long time limit, so that one might question the need to attach the 
terms "conventional" or "extended" to I (a). Indeed, one might even question the need to define Q{a) when 
one has /(a). 

One example of nonequilibrium observables that illustrates the notion of extended fluctuation theorem 
is the heat per unit time dissipated by the dragged particle of Example VI. 9. For this observable, van Zon 
and Cohen [274, 276] have shown that the symmetry on X{k) holds only on a bounded interval due to 
the fact that A(/c) does not converge for all fc G M. Violations of the fluctuation theorem have also been 
shown to arise from the choice of initial conditions [101, 233, 28i], the unboundness of the observable 
considered [ ], or the restriction of the domain of X{k) [130, 235]. These violations are all included in 
large deviation theory insofar as they reflect special properties of rate functions and their associated scaled 
cumulant generating functions. Indeed, many of the limiting cases of rate functions that we have discussed in 
Sec. IV do arise in the context of nonequilibrium fluctuations, and lead to violations and possible extensions 
of the fluctuation theorem. The extended fluctuation theorem of van Zon and Cohen [274, 276], for instance, 
is closely related to affine rate functions, studied in Examples III.3 and IV.8. A model for which X{k) is 
found to be nondifferentiable is discussed in [235]. Finally, a model of nonequilibrium fluctuations having 
a zero rate function is discussed in [265]. This model is a Markov equivalent of the sample mean of IID 
symmetric Levy random variables that was considered in Example IV. 2. 

To close our discussion of fluctuation relations and fluctuation theorems, note that a fluctuation theorem 
may hold approximately for the small values of Aj- even if its associated X{k) does not satisfy the symmetry 
X{k) = X{—k — c). This follows by noting that if a large deviation principle holds for Ar with a rate function 
I{a) which is differentiable at o = 0, then Q{a) w — 2/'(0)a to first order in a [6, ini]. if /(q) has a 
parabolic minimum a*, we can also write g{a) « 21" {a*)a* a to second order in a — a*. In both cases, Q{a) 
is linear in a, which is the defining property of conventional fluctuation relations. 

D. Interacting particle models 

Markovian models of interacting particles, such as the exclusion process, the zero-range process, and 
their many variants (see [186, 250]), have been, and still are, extensively studied from the point of view of 
large deviations. The interest for these models comes from the fact that their macroscopic or hydrodynamic 
behavior can be determined from their "microscopic" dynamics, sometimes in an exact way. Moreover, 
the typicality of the hydrodynamic behavior can be studied by deriving large deviation principles which 
characterize the probability of observing deviations in time from the hydrodynamic evolution [158]. The 
interpretation of these large deviation principles follows the Freidlin-Wentzell theory, in that a deterministic 
dynamical behavior — here the hydrodynamic behavior — arises as the global minimum and zero of a given 
(functional) rate function. From this point of view, the hydrodynamic equations, which are the equations of 
motion describing the hydrodynamic behavior, can be characterized as the solutions of a variational principle 
similar to the minimum dissipation principle of Onsager [15]. 

Two excellent review papers [1 7, 5(] have appeared recently on interacting particle models and their 
large deviations, so we will not review this subject in detail here. The next example illustrates in the simplest 
way possible the gist of the results that are typically obtained when studying these models. The example 
follows the work of Kipnis, OUa and Varadhan [ 61], who were the first to apply large deviation theory for 
studying the hydrodynamic limit of interacting particle models. 

Example VI.ll (Simple symmetric exclusion process). Consider a system of k particles moving on the 
lattice Z„ of integers ranging from to n, n > A;; see Fig. 20(a). The rules that determine the evolution of 
the particles are assumed to be the following: 

• A particle at site i waits for a random exponential time with mean 1, then selects one of its neighbors 
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FIG. 20: (a) Exclusion process on the lattice Z„ and (b) rescaled lattice Z„/n. A particle can jump to an empty site 
(black arrow) but not to an occupied site (red arrow). The thin line at the bottom indicates the periodic boundary 

condition 77(0) = ?7(1). 

J at random; 

• The particle at i jumps to j if j is unoccupied; if j is occupied, then the particle stays at i and goes to 
a waiting period again before choosing another neighbor to jump to (exclusion principle). 

We denote by 77^(1) the occupation of the "site" i € Z„ at time t, and by rn = {r]t{0) , r]t{l) , ■ ■ ■ , ??i(n — 1)) 
the whole configuration or microstate of the system. Because of the exclusion principle, rit{i) G {0, 1}. 
Moreover, we impose boundary conditions on the lattice by identifying the first and last site. 

The generator of the Markovian process defined by the rules above can be written explicitly by noting 
that there can be a jump from i to j only if 77(f) = 1 and r]{j) = 0. Therefore, 

{Lf){r,) = \ Y. ^»[l-^(j)][/(r?^'^)-/(^)], (276) 

where / is any function of 77, and 77*'-' is the configuration obtained after one jump, that is, the configuration 
obtained by exchanging the occupied state at i with the unoccupied state at j: 

{7]{i) ii k = j 
i]{j) iik = i (277) 

77(A;) otherwise. 

To obtain a hydrodynamic description of this dynamics, we rescale the lattice spacing by a factor 1/n, as 
shown in Fig. 20(b), and take the limit ?i — > 00 with r = k/n, the density of particles, fixed. Furthermore, 
we speed-up the time t by a factor n'^ to overcome the fact that the diffusion dynamics of the particle system 
"slows" down as n —^ 00. In this limit, it can be proved that the empirical density of the rescaled dynamics, 
defined by 

^r(^) = - E ''nHii) S{x - i/n), (278) 

77- ^-^ 

where x is a point of the unit circle C, weakly converges in probability to a field pt{x) which evolves on C 
according to the diffusion equation 

dtptix) = d,,ptix). (279) 

It can also be proved that the fluctuations of 7r"(x) around the deterministic field pt{x) follows a large 
deviation principle, expressed heuristically as 

PnK = n] = PniiTTUx) = ^t(x)}Lo) ^ ^""'^^'^ ■ (280) 

The interpretation of this expression follows the interpretation of the density Pe[x] considered earlier: 
Pn [tt" = it] is the probability density for the evolution of a field in time, so that the rate function shown in 
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(280) is a space and time functional of that field. The expression of this rate function is relatively complicated 
compared to all the rate functions studied in this review. It involves two parts: a static part, which measures 
the "cost" of the initial field vtq , and a dynamic part, which measures the cost of the deviation of vr" from pu 
see [161] for the full expression of the rate function, and [95] for a discussion of its physical interpretation. 

The previous example can be generalized in many different ways. One can consider asymmetric exclusion 
processes for which the diffusion is enhanced in one direction (see, e.g., [ 5, 57]), or extended exclusion 
processes for which jumps to sites other than first neighbors are allowed. One can also consider models that 
allow more than one particle at each site, such as the zero-range process (see, e.g., [1 4, 1 67]), or models with 
particle reservoirs that add and remove particles at given rates. Moreover, one can choose not to impose the 
exclusion rule, in which case the particles jump independently of one another [ 59, 160]. 

For many of these models, large deviation principles have been derived at the level of the empirical density 
or density field [ , ''9, 60, 61, I ], as well as at the level of the current [ 1 , 22, 23], which measures the 
average number of particles moving on the lattice. The rate functions associated with these observables show 
many interesting properties. In the case of the totally asymmetric exclusion process, for instance, the rate 
function of the density field is nonconvex [ i9, 61]. This provides a functional analog of nonconvex rate 
functions. The reader will find many details about these large deviation results in the two review papers 
mentioned earlier. The first one, written by Derrida [ ], is useful for gaining a feeling of the mathematics 
involved in the derivation of large deviation results for interacting particle models. The review written by 
Bertini et al. [ ~], on the other hand, is useful for gaining an overview of the different models that have been 
studied, and of the theory that describes the fluctuations of these models at the macroscopic level. For a study 
of interacting particle systems based on the Donsker-Varadhan theory, see [ ]. 

To close this short discussion of large deviations in interacting particle models, let us mention that Derrida 
and Bodineau [' ' ] have formulated a useful calculation tool for obtaining the rate function of the current in 
interacting particle models, which they dubbed the additivity principle. This principle is close in spirit to the 
Freidlin-Wentzell theory (see Sec. VI A), and appears to be based, as for that theory, on a Markov property 
of fluctuations. For a presentation of this principle and its applications, see Derrida [56]. 

VII. OTHER APPLICATIONS 

The results, techniques, and examples compiled in the previous sections make for a more or less 
complete toolbox that can be used to study other applications of large deviations in statistical mechanics. We 
conclude this review by mentioning four more important applications related to multifractals, chaotic systems, 
disordered systems, and quantum systems. Our discussion of these applications is far from exhaustive; our 
aim is merely to mention them, and to point out a few useful references for those who want to learn more 
about them. 



A. Multifractals 

The subject of multifractal analysis was developed independently of large deviation theory, and is typically 
not presented from the point of view of this theory (see, e.g., [ ^, 97, ^03, ^ ~ ]). The two subjects, however, 
have much in common. In fact, one could say that multifractal analysis is a large deviation theory of 
self-similar measures, or a large deviation theory of the measure equivalent of self -processes, studied in 
Sec. rV E. A presentation of multifractal analysis in these terms is given in [ 280, 292], as well as in the book 
ofHarte[132]. 

The idea that multifractal analysis is related to large deviation theory, or is an application of large deviation 
theory, becomes more obvious by noting the following: 

• The two basic quantities commonly employed to characterize multifractals — the so-called multifractal 
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spectrum and structure function — are the analogs of an entropy and a free energy function, respectively; 

• The scaling limit underlying the multifractal spectrum and the structure function has the form of a 
large deviation limit; 

• The multifractal spectrum and structure function are related by Legendre transforms. 

The last point is the perhaps the most revealing: the fact that two functions are found to be related by a 
Legendre (or Legendre-Fenchel) transform is often the sign that a large deviation principle underlies these 
functions. This is the case for the entropy and the free energy of equilibrium statistical mechanics, as we 
have seen in Sec. V, and this is the case, too, for the multifractal spectrum and the structure function. 

By re-interpreting in this way multifractal analysis in terms of large deviations, we do more than just 
translating a theory in terms of another — we gain a rigorous formulation of multifractals, as well as a guide 
for deriving new results about multifractals. One case in point concerns nonconvex rate functions. It had been 
known for some time that the structure function of multifractal analysis, which is the analog of the function 
'^{(3) or \{k) studied here, can be nondifferentiable, and that the nondifferentiable points of this function 
signal the appearance of a multifractal analog of first-order phase transitions (see [ ] and references cited 
therein). Some confusion reigned as to how the multifractal spectrum had to be calculated in this case. Many 
authors assumed that the multifractal spectrum is always the Legendre-Fenchel transform of the structure 
function, and so concluded that the spectrum must be affine if the structure function is nondifferentiable 
[134, 261]. The correct answer given by large deviation theory is more involved: the multifractal spectrum 
can be concave or nonconcave, in the same way that an entropy can be concave or nonconcave. If it is 
concave, then it can be calculated as the Legendre-Fenchel transform of the structure function, otherwise, it 
cannot. A recent discussion of this point can be found in [ " ']; see also [236, 259, 260] for mathematical 
examples of multifractals having nonconcave spectra. 

B. Thermodynamic formalism of cliaotic systems 

The Freidlin-Wentzell theory of differential equations perturbed by noise has its analog for discrete-time 
dynamical maps, which was developed by Kifer [ uu, u ] . One interesting aspect of dynamical systems, 
be they represented by flows or maps, is that they often give rise to large deviation principles without a 
perturbing noise. In many cases, the chaoticity and mixing properties of a deterministic system are indeed 
such that they induce a seemingly stochastic behavior of that system, which induces, in turn, a stochastic 
behavior of observables of that system. The study of this phenomenon is the subject of the theory of chaotic 
systems and ergodic theory (see, e.g., [2, 79, 118, 169]), and the study of large deviations in the context of 
these theories is the subject of the so-called thermodynamic formalism developed by Ruelle [243, 244] and 
Sinai [248, 249]. For an introduction to this formalism, see [12, 152]. 

As in the case of multifractals, the thennodynamic formalism was developed independently of large 
deviation theory. But it is also clear with hindsight that this formalism can be re-interpreted or recast in the 
language of large deviations. The basis of this interpretation can be summarized with the following basic 
observations: 

• The so-called topological pressure, which plays a central role in the thermodynamic formaUsm, is a 
scaled cumulant generating function; 

• The entropy function of an observable, as defined in the thermodynamic formalism, is a rate function; 

• The topological pressure and entropy are related by Legendre transforms when the entropy is concave; 
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• An equilibrium state in the thermodynamic formalism has the same large deviation interpretation as an 
equilibrium state in equilibrium statistical mechanics: both are the solution of a variational principle 
which can be derived from the contraction principle. 

The reader is referred to the review paper of Oono [ ] for an explanation of some of these points; see 
also [147, 206, ""^ ]. A number of results that establish a direct connection between dynamical systems 
and large deviation theory can be found in [152, 187, 232, 284, 289, 290]. For a derivation of fluctuation 
theorems in the context of chaotic maps, see [198]. Finally, for a large deviation study of multiplicative 
processes in deterministic systems having many degrees of freedom, see [ ] and references therein. 

At the time of writing this review, a complete presentation of the thermodynamic formalism that refers 
explicitly to large deviation theory has yet to appear. The fact that chaotic maps can be thought of as 
continuous-state Markov chains with transition matrix given by the Frobenius operator appears to be a good 
starting point for establishing a direct link between the thermodynamic formalism and large deviation theory 
(see, e.g., [^_.,^^^]). 

C. Disordered systems 

The application of large deviation techniques for studying disordered systems focuses in the literature 
on two different models: random walks in random environments (see, e.g., [47, 1 14, 279, 291]) and spin 
glasses (see, e.g., [vVy, , ,, — -]). Large deviation principles can be derived, for both applications, at the 
quenched level, i.e., for a fixed realization of the random disorder, or at the annealed level, which involves an 
average over the disorder. An interesting question in the context of random walks in random environments 
is whether a large deviation arises out of an atypical state of the walk or out of the atypicality of a specific 
random environment. A similar question arises for spin glasses in the form of, is the equilibrium state of a 
spin glass obtained for a specific random interaction typical in the ensemble of all interactions? The book of 
den Hollander [54] and the recent review paper by Zeitouni [291] offer two good entry points to the first 
question; see [28, 255] for a mathematical discussion of spin glasses. 

From the large deviation point of view, the difference between disordered and regular systems is that 
generating functions defined in the context of the former systems have an extra dependence on a "disorder" 
variable, which implies that these generating functions are random variables themselves. Therefore, in 
addition to studying the "quenched" large deviations associated with a given "random" generating function 
(i.e., a generating function arising for a given realization of the disorder), one can study the large deviations 
of the generating function itself, in order to detennine the most probable value of the generating function. 
This concentration value of the generating function often simplifies the study of "annealed" large deviations, 
which are obtained from generating functions averaged over the disorder. For a discussion of spin glasses 
which follows this point of view, see the recent book of Mezard and Montanari [^05]. 

D. Quantum large deviations 

Quantum systems have entered the large deviation scene relatively recently compared to classical systems: 
end of 1980s compared to early 1970s. Applications of large deviations for studying boson gases are 
described in [39, 70, 268]; quantum gases are considered in [ 1 1 3, 1 7 1 , 1 ], while quantum spin systems are 
considered in [135, 177, 211]. For an application of Varadhan's Theorem for a class of mean-field quantum 
models, see [228]. 

A quantum version of Sanov's Theorem is presented in [ ' ']. As for classical version of that theorem, the 
quantum version plays an important role in the theory of estimation and in information theory, as generalized 
to the quantum world [1,5, 153]. Finally, a quantum adaptation of the Freidlin-Wentzell theory of dynamical 
systems perturbed by noise can be found in [19]. 
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APPENDIX A: SUMMARY OF MAIN MATHEMATICAL CONCEPTS AND RESULTS 

• Large deviation principle (Sec. Ill): Let {An} he a sequence of random variables indexed by the 
positive integer n, and let P{An G da) = P{An G [a,a + da]) denote the probability measure 
associated with these random variables. We say that An or P(A„ e da) satisfies a large deviation 
principle if the Umit 

/(a) = lim --lnP(A„ e da) (Al) 

71— *oo n 

exists (see Appendix B for a more precise definition). The function /(a) defined by this limit is called 
the rate function; the parameter n of decay is called in large deviation theory the speed}'^ 

• Asymptotic notation: The existence of a large deviation principle for An means concretely that the 
dominant behavior of P{An G da) is a decaying exponential with n, with rate exponent /(a). We 
summarize this property by writing 

P{An G da) X e-"^^'') da. (A2) 

The infinitesimal element da is important in this expression; if we work with the probability density 
p{An = a) instead of the probability measure P{An G da), then the large deviation principle is 
expressed simply as p{An = a) x e~"^("). 

• Generating function: The generating function of An is defined as 

Wnik) = (e"'=^") = /"e"'="P(A„ G da), k£R. (A3) 

In terms of the density p{An), we have instead 

Wn{k) = fe^'"'p{An = a) da. (A4) 

In both expressions, the integral is over the domain of An- 

• Scaled cumulant generating function: The function A(/c) defined by the hmit 

X{k) = lim -InWnik) (A5) 

n— >oo n 

is called the scaled cumulant generating function of An- It is also called the log-generating function 
or free energy function of A„. The existence of this limit is equivalent to writing Wn{k) x e"^^'^). 

• Legendre-Fenchel transform: The Legendre-Fenchel transform of a function f{x) is defined by 

g{k) = s\xp{kx - f{x)}. (A6) 

X 

This transform is often written in convex analysis in the compact form g = f*. This transform is also 
sometimes written with an infimum instead of a supremum. With the supremum, the Legendre-Fenchel 
transform reduces to the standard Legendre transform when /(x) is strictly convex and differentiable, 
for then 

g{k) = kx{k)-f{x{k)), (A7) 

where x{k) is the unique root of f'{x) = k. The Legendre-Fenchel transform involving the infimum 
reduces to the standard Legendre transform when f{x) is strictly concave and differentiable. The 
formula of the Legendre transform, in this case, is the same as above. 



See footnote 1 1 . 
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• Gartner-Ellis Theorem: If X{k) is differentiable, then An satisfies a large deviation principle with 
rate function /(a) given by the Legendre-Fenchel transform of X{k): 

I{a)=sup{ka-X{k)}. (A8) 

k 

This Legendre-Fenchel transform is expressed in convex analysis by the shorthand notation / = A* . 
(See Sec. Ill for a more precise statement of this theorem.) 

• Varadhan's Theorem: If An satisfies a large deviation principle with rate function /(a), then its 
scaled cumulant generating function \{k) is the Legendre-Fenchel transform of /(a): 

A(A:) =sup{A;a-/(a)}. (A9) 

k 

In shorthand notation, this is expressed as A = /*. (See Sec. Ill for a more precise statement of this 
theorem.) 

• Convex versus nonconvex rate functions (Sec. IV): If /(a) is convex, then / = A*. If /(a) is 
nonconvex, then / / A* . As a corollary, rate functions that are nonconvex cannot be calculated via the 
Gartner-Ellis Theorem because rate functions obtained from this theorem are always convex (strictly 
convex, in fact). 

• Properties of A (A;) (Sec. Ill): 

1. A(0) = 0. This follows from the normalization of probabilities. 

2. A'(0) = lim (An). This property is related to the Law of Large Numbers. 

3. A"(0) = lim nvar(j4„). This property is related to the Central Limit Theorem. 

n— »oo 

4. A(fc) is convex. This implies, among other things, that X{k) can be nondifferentiable only at 
isolated points. 

5. A(A;) is differentiable if I{a) is strictly convex, i.e., convex with no linear parts. 

6. A(A;) has at least one nondifferentiable point if /(a) is nonconvex or has linear parts. 

7. Suppose that A(A;) is differentiable. Then the value k such that X'{k) = a has the property 
that k = I' {a). This is the statement of the Legendre duality between A and /, which can 
be expressed in words by saying that the slopes of A correspond to the abscissas of /, while 
the slopes of / correspond to the abscissas of A. (This property can be generalized to a 
nondifferentiable A(A;) and a nonconvex /(a) with the concept of supporting lines [238].) 

• Contraction principle (Sec. Ill): Consider two sequences of random variables {An} and {Bn} such 
that An = f{Bn), and assume that Bn obeys a large deviation principle with rate function Ib- Then 
An obeys a large deviation principle with rate function I a given by 

lAia)= inf /b(6). (AlO) 

a:f{b)=a 

• Connection with physics: Entropies are rate functions; free energies are scaled cumulant generating 
functions. 
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APPENDIX B: RIGOROUS FORMULATION OF THE LARGE DEVIATION PRINCIPLE 

This appendix is an attempt at explaining the rigorous formulation of the large deviation principle for the 
benefit of physicists not versed in topology and measure theory. The formulation presented here is inspired 
from the work of Ellis [83, 85, 86, 87], which is itself inspired from Varadhan [277]. For background material 
on topology and measure theory, the reader should consult Appendices B and D of ['"]. 

The rigorous definition of the large deviation principle is based on four basic ingredients: 

• A sequence of probability spaces {(A„, .7>t, Pn),n G N} consisting of a probability measure Pn 
defined on the set J^n of all (Borel) sets of the "event" set A„; 

• A sequence of random variables {Yn, n G N} mapping A„ into a complete, separable metric space X, 
also known as a Polish space; 

• A sequence {a„ : n G N} of positive constants such that o„ ^ oo as n ^ oo; 

• A lower semi-continuous function I{x) mapping X into [0, cxd]. 

From the point of view of statistical mechanics, A„ can be thought of as the space of the microstates of an 
n-particle system. The set J^n is the set of all possible events (sets) on A„ , whereas P„ is a probability measure 
on Tn- The fact that we are dealing with a "sequence" of probability spaces is there, of course, because we 
are interested in studying the behavior of Pn in the limit n —>■ oo, which we call the thermodynamic limit. In 
the same vein, Yn should be thought of as a macrostate, and X as the macrostate space. One can think of 
Yn, for example, as the mean magnetization of a simple spin model, in which case X = [—1, 1]. In all the 
applications covered in this review, A' is a subset of M'^, and so we need not bother with the fact that A" is a 
"complete, separable metric" space. This requirement is a technicality used by mathematicians to make the 
theory of large deviations as general as possible. 

The random variable for which we are interested to formulate a large deviation principle is Y^. The 
probability measure i-*„ defined at the level of A„ is extended to Yn via 



Pn{Yn eB)= f Pnidio) 

J \wGkr,:.Yr,{ix))GB\ 



(Bl) 

'{t<;GA„:y„(a;)e-B} 

where B is any subset of X. Given this probability, we say that the sequence {y„, n G N} satisfies a large 
deviation principle on X with rate function I and speed an if for any closed set C, 

lim sup — In P„(y„ G (7) < - inf I{y) , (B2) 

and for any open set O, 

lim inf — In P„(y„ G O) > - inf I{y) . (B3) 

n— >oo a.„ yeO 

The lower semi-continuity of / guarantees that this function achieves its minimum on any closed sets (a 
lower semi-continuous function has closed level sets; see Chap. 5 of [272]). 

The two limits (B2) and (B3) give a rigorous meaning to the two bounds mentioned in our formal 
discussion of the large deviation principle; see Sec. III. To understand why the first limit involves closed sets 
and the second open sets, we need to invoke the notion of weak convergence. The idea, as partly explained in 
Sec. Ill, is that we wish to approximate a measure /i„ by a limit measure /x such that 

lim / f{y)pn{dy) = [ f{y)ii{dy) (B4) 

'^^^^ Jx Jx 
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for all bounded and continuous functions f : X —>■ R. Though less transparent, an equivalent and often 
more practical way of expressing the weak convergence of /i„ to fi is provided by the so-called Portmanteau 
Theorem (see Sec. D.2 of [ ]), which states that the limit (B4) is equivalent to 

limsup^„(C) < ^(C) (B5) 

n— >oo 

for all closed subsets C oi X, and 

liminf/i„(0) >/i(0) (B6) 

for all open subsets O of X. These two limits correspond to the two limits shown in (B2) and (B3), with /i„ 
equal to a^^ In P„ to account for the scaling P„ x e^"'"^ , I > 0. 

The heuristic form of the large deviation principle that we use as the basis of this review is a simplification 
of the rigorous formulation, in that we assume, as in Sec. Ill, that the large deviation upper and lower bounds, 
defined by (B2) and (B3) respectively, are the same. This is a strong simplification, which happens to be 
verified only for so-called I-continuity sets, that is, sets A such that 

infl(y)= inf I{y), (B7) 

j/sA yeA° 

where A and A° denote, respectively, the closure and relative interior of A; see Sec. 3 of ['-'^] or [^''^J for 
more details. In treating large deviations, we also take the simplifying step of considering probabilities of the 
form P{Yn € dy), where dy = [y,y + dy] with a bit of abuse of notation, in which case 

lim —In P(y„ Gdy) = - inf I{x) = -I{y). (B8) 

"^oo a„ xi^[y,y+dy] 

Finally, in most examples covered in this review, the speed a^ is equal to n. In statistical mechanics, the 
proportionality of a„ with n is an expression of the concept of extensivity. 

APPENDIX C: DERIVATIONS OF THE GARTNER-ELLIS THEOREM 

We give here two derivations of the Gartner-Ellis Theorem for random variables taking values in M. The 
first derivation is inspired from the work of Daniels [5 1] on saddle-point approximations in statistics, and is 
presented to reveal the link that exists between the large deviation principle, the saddle-point approximation, 
and Laplace's approximation.^^ The second derivation is based on a clever change of measure which goes 
back to Cramer [ ], and which is commonly used nowadays to prove large deviation principles. None of the 
derivations are rigorous. 

1. Saddle-point approximation 

Consider a random variable 5„(u;) which is a function of a sequence lu = {uji,uj2, ■ ■ ■ , ^n) of n random 
variables. The random variable 5„ need not be a sample mean, but it is useful to think of it as being one. 
For simplicity, assume that the Wj's are also real random variables, so that to £ M". Denoting by p{uj) the 
probability density of lu, we write the probability density of Sn as 



p{Sn = s)= p{uj)duJ=l 6{Sn{uj) - s)p{uj)duJ = {S{Sn- S)) , (CI) 

J{uj(^R":S„{uj)=s} 



~^ The so-called Darwin-Fowler method [':')'] used in statistical mechanics is yet another example of saddle-point or Laplace 
approximation applied to discrete generating functions. 
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just as in Eq. (6) of Sec. II. Using the Laplace transform representation of Dirac's delta function, 

<5(s) = — / e^MC, aGR, (C2) 

we then write 

-1 /"a-fioo p -1 pa-\-ioo p 

p{Sn = s) = -^ dC / dtjp(tj)e^[^"('^)"*l = -^ / dCe"^^ / dto p{uj) e'^^"^'^\ (C3) 

The integral of the Laplace transform is performed along the so-called Bromwich contour, which runs parallel 
to the imaginary axis from C, = a — icxD to C = a + ico, a G M. 

At this point, we anticipate the scaling of the large deviation principle by performing the change of 
variable C, — > nC,, and note that if 

A(C) = lim -ln/e"'^^'A (C4) 

exists, then 

pa+\oo 

p{Sn = s)^ d(C)e-"[f^-^«)] (C5) 

^a— ioo 

with sub-exponential corrections in n. By deforming the contour so that it goes through the saddle-point C,* of 
Qs — A(C), and by considering only the exponential contribution to the integral coming from the saddle-point, 
we then write 

p{Sn = s) X / d(-iC) e-"K^-^(^)] X e-"K*^-^(^*)l. (C6) 

^^*— ioo 

The last approximation is the saddle-point approximation (see Chap. 6 of [ ]). This result is completed by 
noting that the saddle -point (* must be real, since p{Sn = s) is real. Moreover, if we assume that A(C) is 
analytic, then (* is the unique minimum of (s — A(C) satisfying X'{C*) = s along the Bromwich contour. The 
analyticity of A(A;) also implies, by the Cauchy-Riemann equations, that the point (^*, which is a minimum of 
Cs — \{C) along the Bromwich contour, is a maximum of (s — \{Q for ( real. Therefore, we can write 

lim lnp{Sn = s) = sup{A;s — A(A:)}, . (C7) 

71— >oo n 



This concludes our first derivation of the Gartner-Ellis Theorem. For a discussion of cases for which A(fc) is 
not analytic, see Sec. IV. 

2. Exponential change of measure 

We consider the same random variable 5„(lij) as in the previous derivation, but now we focus on 
the probability measure P{dLu) instead of the probability density p(w). We also introduce the following 
modification or "perturbation" of ^(da;): 

„nkSn{uj) 

^^(do;) = -j-;^j^P{du), (C8) 

which involves the parameter fc € M. This probability has the same form as the probability P/3(dw) defining 
the canonical ensemble. In large deviation theory, Pk{duj) is called the tilted measure, and the family of such 
measures indexed by k is often called the exponential family [ ].^^ 

Starting from the definition of Pj^{duj), one can prove the following properties (see [83, 84, 1 17]): 



' In statistics and actuarial mathematics, Pk is also known as the associated law or Esscher transform of P [ . Cj]. 
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Property 1: If 



X{k) = lim -ln/e"'=^"\ (C9) 

exists, then 

PkiM X e"['=^"(-)-^(^)lp(du;). (CIO) 

The so-called Radon-Nikodym derivative of Pjt(dLij) with respect to P(du;) is thus written as 

dPH P{Auj) ^ ■ ^ ' 

Property 2: If \{k) is differentiable at k, then 

lim (5„);, = lim / 5„(u;) Pfc(da;) 

n^oo n— »oo Jmn 

= lim — J^ / 5.Me"*=^"(-)p(d^) 

= A'(fc). (C12) 

Property 3: The value s^ = A'(fc) is the concentration point (viz., typical value) of 5„ with respect to 
Pfc(dLij), that is, 

lim P^{Sn G [sfc, Sfc + ds]) = 1. (C13) 

n— >oo 

This limit expresses a Law of Large Numbers for Sn with respect to Pk{AiS)P 
From these properties, we obtain a large deviation principle for P{Sn € ds) as follows. Starting with 



P(5. e d.) = / P(d^) = / ^^ P,(d..) 



(CI4) 



we use the first property to obtain 

J{a;GM":5„(a;)eds} 

= e-'^['=*-^Wl / Pfc(da;), (C15) 



'{ajeK":5„{aj)eds} 

which implies 

P(5„ G ds) X e-"['=^-^('=)] P,,(S„ G ds). (CI6) 

Next we choose k such that A'(A;) = s. According to the second and third properties, we must have 

lim Pu{Sn G [s, s + ds]) = 1 (C17) 



Recall that the concentration point of S„ with respect to P(Auj) is sq = -^'(0); see Sec. HIE 1. 
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or, equivalently, Pk{Sn G ds) x e"'' ds using the asymptotic notation, so that 

P{Sn G ds) X Q-^[ks-X{k)] ^^^ ((3jg^ 

Therefore, P{Sn G ds) x e~"^*^'^), where 

I(s) = A:s-A(A:), \'{k)=s. (C19) 

We recognize in the last expression the Legendre transform of A(A;). 

This derivation can be adapted to other random variables and processes, and is useful in practice for 
deriving large deviation principles, as the Radon-Nikodym derivative can often be calculated explicitly. In the 
case of Markov processes, for example, dP^/dP is given by Girsanov's formula [ ]. Other perturbations 
of P, apart from the exponential one, can also be used. The general idea at play is to change the measure (or 
process) P into a measure P' , so as to make an unlikely event under P a typical event under P' , and to use 
the relationship between P and P' to infer the probability of that event under P. 

APPENDIX D: LARGE DEVIATION RESULTS FOR DIFFERENT SPEEDS 

The Gartner-Ellis Theorem is stated and used throughout this review mostly for large deviation principles 
having a linear speed a„ = n. The following is the general version of that theorem which applies to any 
speed a„ such that a„ ^ oo as n ^ oo [84]. Consider a random variable Wn such that 

A(A;) = lim — ln/e''"'=^"\ (Dl) 

exists and is differentiable. Then P{Wn G dw;) x e"""^^"'-' dw, where I{w) is, as before, the Legendre- 
Fenchel transform of A(A;). 

The version of Varadhan's Theorem that applies to general speeds is the following [ ]. Let Wn be a 
random variable satisfying a large deviation principle with speed a„ and rate function I{w), and let / be a 
bounded function of Wn- Then 



A(/) = lim — In /e'^"-^(^" A =sup{/H -IH}. 

n—*co an \ I w 



(D2) 



For the (unbounded) linear function /(M^n) = kWn, it can also be proved, with an additional mild assumption 
on Wn (see, e.g.. Theorem 5.1 of [ ] or Theorem 4.3.1 of [53]), that 

\{k) = lim — In /e'^"'=^"\ = supj/tu; - I{w)]. (D3) 

n^oo an \ I w 
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